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ABSTRACT 

One of a series dealing vith reading, mathematics, 
language arts, social studies, science, cultural arts, health, and 
physical education, this report oi; language arts is designed to help 
North Carolina teachers in planning instructional programs tor public 
school students and to inform the general public of students' 
educational needs and attainments. This assessment contains results 
and analyses of tests administered to 2500 randomly selected 
third-grade students in North Carolina. The students* skills in 
language arts were assessed by a noim-ref erenced test (Iowa Test of 
Ba.iic Skills) and an ob jective-based test (developed at the state 
level). Discussions of the nature of each of these tests end their 
interpretations as well as comparisons of achievement levels between 
North Carolina third graders and students throughout the Onited 
States are included. Numerous tables and graphs illustrate points 
made in the text. (LL) 
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FOREWORD 



As one of the ways to improve the quality of public education in the 
State, personnel in the State Department of Public Instruction conduct an 
annual assessment of educational performance. This assessment provides 
educational decision makers with accurate and objective information for 
planning and administering the State's public elementary and secondary 
schools. 

This year, a series of reports will be released on the performance 
of third-grade students. The reports will include reading, mathematics, 
language arts, social studies, science, cultural arts, health, and 
physical education. Also, special surveys on teachers' and principals' 
opinions of education will be released. All of this information should 
also help the general public to be better informed about the status of 
their schools on a statewide basis. 

Aware of the fact that patrons and educators at the local school 
level also wish to know more about the quality of education in their 
schools, the State Department of Public Instruction is initiating a 
program to assist local school personnel to conduct assessment programs. 
Constructive use of this information, as well as statewide data, will 
insure continuing progress in providing appropriate learning experiences 
for all children and youth in North Carolina. 
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PREFACE 



As part of his total effort to initiate better management techniques, 
the State Superintendent of Public Instruction indicated in 1970 that 
more and better information was needed for state-level planning* He 
initiated the State Assessment of Educational Progress in response 
to that need. 

The assessment program was a collaborative effort from the beginning. 
Many levels of the education community contributed suggestions. Funds and 
services for the program were obtained from local, state, and federal 
sources. Cooperation among local and state components of the public school 
system and the nationally respected Resea xh Triangle Institute was 
the backbone of the assessment. There was an open exchange of ideas, 
experiences, and services. 

As a result of these cooperative relationships, the first State 
Assessment of Educational Progress took place in the spring of 1972 
with minimal disruption to school programs. A statewide sample of sixth 
graders participated by completing exercises in reading, mathematics, 
language arts, career awareness, and several dimensions of student 
attitudes. 

At the recommendation of the State Board of Education, the 1973 
Legislature voted to fund the assessment program annually as part of 
the budget of the State Superintendent of Public Instruction. Concurrently, 
an advisory committee of legislators, businessmen, students, parents, and 
educators was formed to assist the State Board end the State Department 
of Public Instruction on aspects of statewide assessment and accountability. 

A three-year cycle of assessment in grades three, six, and nine was 
established, beginning in 1974 with the State Assessment at the third 
grade. In the 1974 assessment, information was collected from teachers 
and principals as well as students. Student performance measures were 
taken in language arts, mathematics, cultural arts, reading, science, 
social studies, health, and physical education. Reports are now being 
prepared on the results. 
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IMRODUCTION 



Purpose of the Assessment 
In order to improve educational planning and decision -making in North 
Carolina, the State Department of Public Instruction initiated a statewide 
assessment of educational progre^;. The information gathered through this 
assessment operation has three basic purposes: 

1) To examine the state's present educational position: Knowing 
the educational status will enable educators to plan better 
programs for improving learning and teaching. Objective 
information will help decision-makers set program priorities 
with more assurance and allocate resources on the basis of 
need. An accurate description of the current status will 
increase general public knowledge and understanding about 
the public schools. 

2) To measure educational progress over a period of years: 
As time passes, a charting of the educational progress in 
this state can be made. These benchmarks of educational 
quality could become the basis for educational accountability 
for the state. 

3) To seek means of improving North Carolina's education: As 
more information is collected in the state assessments, 
variables which affect learning can be examinad, and those 
variables which show a positive influence on learning- can be 
promoted. 

In addition, the state assessment effort provides local units with 
technical assistance in planning similar local programs which aid the setting 
of local priorities. Goals may be set using meaningful state and regional 
norms which are rade available from the statewide effort. Furthermore, 
assessment information collected in each school will assist teachers in 
planning better instructional programs for public school youngsters and 
help patrons and parents to better understand the educational needs and 
attainments of North Carolina children. 
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!n a continuing attempt to develop and improve North Carolina's 
assessment program, the Lsgislature, adding its encouragement through program 
support, approved funds in 1973 as a part of the State Superintendent's 
program budget to underwrite the statewide assessment ef-^ort. This State 
Assessment at the third-grade level is the first stage in a proposed three- 
year assessment cycle. In 1974-75, assessment will occur in the sixth grade, 
and, in 1975-76, at the ninth-grade level. 

Implementation of the Assessment 

The Sample 

Selecting third graders to participate in the assessment program was 
the responsibility of the Research Triangle Institute, assisted by the 
State Department of Public Instruction. The objective was to choose a 
representative sample of size sufficient to provide reliable estimates of 
test score averages for the State, the Coastal Plains, the Piedmont, and 
the Mountains. Independent samples of 2500 students were considei*ed 
appropriate for each of the five areas described in the section entitled 
"Assessment Areas". The total third grade enrollment of the eighteen 
schools containing 1970-7'i ^ cate-supported kindergartens provided approxi- 
mately 2,000 students for a special assessment follow-up. 

A two-stage sa.npling procedure was designed to select the 12,500 
students for the fi>'st five areas. In order to give each third grade 
student in Mc-ch Carolina an equal chance of being chosen, 618 schools were 
randomly selected with the probability of school selection based upon 
stratification according to the size of the third-grade enrollment. 

Random selection of students within schools was controlled to preserve 
the proportion of ESEA Title I enrollment within the third-grade class. 
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Of the 93,752 third-grade students in North Carolina, the chance of selection 
for any child was ten out of seventy-four. 

Field Procedures 

An Assessment Coordinator was designated by the superintendent of each 
participating LEA to organize all assessment activities. The activities 
included: (1) selecting and coordinating the testing schedule, (2) distrib- 
uting and collecting test packages and questionnaires, and (3) providing 
information and assistance to the test administrators and principals. 
With the approval of the superintendent. Assessment Coordinators also selected 
someone other than the student's classroom teacher to administer the tests. 
These administrators read aloud all items which did not test the student^s ability 
to read. To insure standardization of test procedures, the Division of Research 
staff held workshops to acquaint coordinators and administrators with assess- 
ment procedures. 

Assessment Areas 

The 1973-74 Assessment of Third Graders consisted of five different 
assessment areas and an additional researcn package for the evaluation of 
third graders who had previously attended state-supported kindergarten. 
In addition to student measures, all teachers (grades K-6) and principals 
of the 618 schools included in the student sample were asked to respond to 
questionnaires designed to reflect their opinions about the educational 
needs and pri'-^^ities in North Carolina. 

The subjects included in the six assessment areas and the type of 
testing involved are listed in Table 1. 

3 
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TABLE 1 

OVERVIEW OF 1973-74 ASSESSfCNT AREAS, TESTING, AND SAMPLING 





Assessment Area 


Type of Testing 


Number of 
Students Sampled 


Reading, Math, Language Arts 


Norm Referenced 
(Icwa Tests of Basic 
Skills) 


2,500 


Reading, Math, Language Arts 


Objective Based 


2,500 


Health and Physical Education 


Objective Based 
Motor Performance 


2,500 


Cultural Arcs 


Perception Survey 


2,500 


Science and Social Studies 


Objective Based 


2,500 


Third-Grade Kindergarten 
Follow-up 


Norm Referenced 
(lowo Tests of Basic Skills 
(Cognitive Abilities Test) 
(Self Observation Scale) 


2,000 



Types of Instruments 

Reading, Language Arts, and Math were eech assessed by both a norm- 
referenced test (lowd Tests of Basic Skills) and an objective based test 
developed at the state level. The difference in the kinds of information 
provided by the two types of measurements should be considered when 
interpreting test results. 

Nationally standardized achievement tests, such as the Iowa Tests of 
Basic Skills, are designed to provide information about student performance 
in given subject areas in relation to the performance of other students 
who are representative of the nation as a whole. The national sample of 
students taking the ITBS is the "norm" or reference group to whose perform- 
ance we compare our state results. Thus, the ITBS provides information on 

the educational status of North Carolina third-grade students in relation 
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to the performance of a national sample of "typical" third graders. Such 
standardized tests also assume a continuum of achievement skills based upon 
the scores of the national sample. North Carolina's third-grade results may 
be considered against this continuum. 

Norm- referenced tests are designed to spread out developmental scores 
on a continuum of skills spanning several grade levels. However, they 
do not tell us specifically what our students have achieved or how they 
perform on a given set of educational tasks. Some items on the ITBS can 
admittedly be grouped into subject area objectives, but the test is not 
designed for diagnostic purposes. 

Therefore, objective-based tests were developed for the areas of 
reading, language arts, and mathematics in order to assess more specific 
knowledge of North Carolina's students. Program area specialists and 
researchers collaborated on this review and selection process. Question- 
naires were developed, information gathered, standardized tests carefully 
reviewed, and objectives and items finally selected in accord'with some 
of the major educational goals of North Carolina. 

Objective-based tests* also known as criterion-referenced tests, 
are developed differently from norm-referenced tests. They facilitate 
assessing the extent to which students have learned seme defined behavior 
domain or specific class of learner skills. These behavior domains are 
also referred to as objectives. Specific objectives considered important 
or crucial for later skills are selected for each subject area. Then, 
items selected to measure these objectives determine how well students have 
learned the knowledge or behavior described by the objectives. Objective- 
based tests are thus diagnostic of specific learning, rather than more 

broadly comparative in natuit - as are the norm-referenced tests. 
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strengths and weaknesses of a gy*oup of students for a given subject area 
are thus determined, and sonietinies, though not necessarily, in relation to 
d nonn group. 

It IS important in making educational program decisions to know 
specifically what students have learned as well as how they are generally 
performing in relation to other students. For this reason, the assessment 
of third graders included experimental objective-based tests for various 
subject areas. Norm- referenced and objective-based tests when combined, 
should provide a more complete picture of the performance of North Carolina 
students. 

In addition to student performance tests, other instruments were used 
in the North Carolina assessment. Tests were developed on student perceptions 
in some subject areas, and a survey of teachers* and principals' needs was 
taken. The assessment staff also acquired school and community information 
on variables known to be associated with achievement. 

Interpreting Test Scores 

Norm-Referenced Tests 
The ;<riowiedge that student ansvvered seventy-five items correctly 
on 3 ninety-item test tells little in itself about the achievement level 
of the student If we kno«A/, however, that ninety percent of the students 
in the standsraization r.ajnpls earned scores lower than 75, we might conclude 
that the student m question performed rather well. The value assigned to 
a score, then, is determined by comparing that score with scores earned by 
members of the appropriate nonn group. This process of comparing a student's 
score' with a scale based on the test performance of the norm group give<; 
useful, relative meaning to the individual student's score. 
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Systems have been developed for calibrating the distribution of norm 
group scores, making the comparison process easier and at the same time 
more informative. These systems clarify position of scores in relation 
to one another and deal with the problems of direction, distance 
and degree. However, as educational statisticians at the Research 
Triangle Institute have pointed out,... "no single statistic exists for 
completely meaningful interpretation of the oegree of difference between 
(groups of scores)." Therefore, these reports will include a variety of 
reporting systems to aid in the perception of degree. 

One system is based on the relationship between the average number of 
items answered correctly by groups from successive grades (grade equivalent). 
Another compares a student's performance against the percentage of students 
in the national norm group whose scores fell below the student's score 
(percentile rank). Still another system looks at Item performance. (Norms 
for item performance are available for the ITBS.) The percentage of students 
in the national norm group who answered each Item correctly provides a means 
of Lompar]son for the Item performance of North Carolina's students (item 
d^'fficulty). Other systems compare the total distributions of the North 
Carolina group against the total distribution of scores in the national 
norm gj^oup 

The procedure for establishing national norms for comparison involves 
choosing a "i^epresentati ve" national sample of students, administering the 
tests to them, and determining the distribution of their scores within each 
grade leveK For example. If a median (average) vocabulary raw score of 
18 was attained by students tested during the first month of their third- 
grade enrollment, the developmental concept grade equivalent (GE) would 
assign a score of 31.0 to the vocabulary raw score of 18- 



Other grade equivalent scores are established from the median (average) 

raw score attained by students at the beginning of other grades (i.e., 21.0, 

31.0, 41.0, etc.) on thi.s te.>c. Grade equivalent scores corresponding to 

each of the ten months of school development between grades (31.0 to 41.0, 

etc.) are detenTiined by dividing the raw scores between the reference points 

into ten intervals for the months of the school year and summer. These 

ten points, of course, represent an average year's development. It would 

be unreasonable to expect below average students to obtain ten points in 

a year while r.ale'ited students should obtain more. The estimate of 

developmental ski 11 from such a system is helpful. However, it does have 

limitations, "^s often misinterpreted and misused, and, therefore, generally 

not recommended as the only reporting device (see Appendix A of the 1973 

Assessment Report). The following paraphrased excerpt from the Teacher's 

Guide to the I TBS is informative. 

The grade equivalent is an estimate of where the pupil is 
along the developmental continuum measured by these items, not 
of whe'^e he shctld be placed in the graded organization of the 
school A ^eccr.d grader with a grade equivalent score of 45 is 
ct tbe 90th percentile of the second grade group, meaning 
that 9G p^.'-Crot of the second grade pupils scored lower and 
10 per:ent r>ccred we^.l or better. This pup il should be 
cons ide-c-'j as being in t he upper 10 percent of x;ne second grade , 
riis grade equivalent of 45 does not indicate that he is ready 
for fourth-grcde work or that he should skip the thi'^d grade. 

The c'jblTsrer ^C'i'^ts cut this ^irUation does ret r^an that grade 

equivalents sI'OUid :-:jt bi: used ai'. He continues, "They are valuable 

indicators of p'^pii growth [particularly for those not considerably above 

or below average] b ut should not be used to determine a pupil's standing 1i 

his grade .., Percentile norms and stanines are provided for this 

purpose," We concur and believe that looking at performance in several 

ways, wh'*le re-ne-nbor ing ihe 1 un:iat;ons of each , is the better approach to 

valid interpretation, 
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Object-! /e-Based Tests 
Generally, objective-based tests results are interpreted by looking at 
the percentage of items achieved (or answered correctly) for a given objectivi 
The desired level of achievement for an objective is a considered, yet 
subjective decision on the part of educators. In some cases, 50 percent 
achievement of an objective at that grade level may be acceptable; in others, 
100 percent may be considered necessary for acceptable performance. The 
level depends on both the purposes for assessing the objective and whether 
or not the objective has been previously taught. In the statewide survey, 
objectives we^e selected that appeared to be commonly relevant to the 
curricular area :hroughout the state or that had some importance for 
state-level planning. Acceptable achievement levels may therefore vary 
with different subjects and objectives. This same process could be repeated 
at the regional local level and the final test may again have different 
objectives, depending on local priorities. A statewide sample of outstanding 
third-grade teachers reviewed the state selection of objective's this past 
s'jfijner for relevsnce and importance to their classes. They also examined 
the item-: and estimated the SKccess they felt their students would achieve 
on them. Howeve.-, due to possible differences which exist across the state, 
a "desired" achievement level was not set for North Carolina. 

Another considtTaLion is r.he number of items per objective. As mentioned 
earlier in the "Types of Instruirents" section, object i'/es reflect specific 
areas or domains of student behaviors. Because only a limited number of 
items can be selected for a given group of behaviors (objectives) the results 
on these items should be carefully interpreted as "indicators" of general 
performance for the objective. 

9 



I^' the^e dre only vwo items per objective, the possible echievement 
levels for tne cbjectv-e er? necessarily 0 percent, 50 percent, and 100 
percent ach' evafoent. S-»jTii ic riy with four iiems for the same objective, 
the possible achievement levels would be expanded tc 0 percent, 25 percent, 
50 percent, 75 percent, and 100 percent. This increase in items enables 
a more specifTc reporting of results at both the student and group level. 
Further, we have a greater assurance that the students (or groups) have 
adequately learned the Aills or behaviors stated in the objective if four 
items are used rather than two. However, no sec rules can be given, as 
seme objectivsii can De rNtated with greater specificity than others and require 
fewer items for adequate measurement. 

Generally, stcitewlde resuUs wiT be reported by objectives and reflect 
the percentage of ijtudents who answer e given number of items correctly for 
the objective. Fr- example, if an objective has three items, results will 
-^how what percentage of students answer one , two, three , or n£ items 
correctly. The number of items a studeiit or group Is expected to an'swer 
coTY'^c^Jy is iigain a conc'dered judgment based on the particular objective 
and the value or priuriry the user places on that objective. 

loformaticn at the item leve^ a^so aids in interpretation as efforts 
are made to dicijnose spcciriv strengths and weaknesses. Thus, the objective- 
based Ui-^ ellovs f^le^ libiliiy to curriculum specialists in assessing important 
de^e'iopm?n:ol .^;<:;is with greater accuracy. Certainly ic adds a valuable 
perspective to those who pl^n North Carolina programs to meet specific 
needs of North Ca^-clina youngsters. 
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Making Valid Conipari<;nn<: nf Test Scores in North Carolina 
Comparisons of test scores may be less than useful if the individuals 
within the groups vary greatly on important characteristics. Comparisons 
of the test scores of classes, schools, local school districts, or sLates 
must be carefully interpreted in light of the inherent differences among 
groups and those individuals who comprise the group. Group comparisons 
can be made validly when the groups as a whole are similar on certain basic 
characteristics. This section will review important characteristics which 
are related to achievement and which differ among the regions of the nation. 
These characteristics should be considered by all who seek to make appropri- 
ate comparisons. The nature of the national norm group will also be described 
in order that state and national comparisons can be viewed from proper 
perspective. 

Characteristics of the National Norm Group 
In interpreting norm-referenced test scores ;„ North Carolina, it is 
important for the reader to know the makeup of the norm group since the 
state's performance comparisons are against the standards set by the students 
who comprise this norm group. 

Prescribed conditions were set forth in the selection of students for 
inclusion in the ITBS norm group. The pupi'is in the sample had to be 
representative of the various abihty and achievement le^el? in the nation. 
The sample had to De sufficient in number tj represent adequately the many 
diverse elements of population within the United States. Accordingly, a 
sample size ot slightly more than 20.000 students per grade was selected. 

Sampling procedures employed seven community size categories. A number 
to represent socioeconomic status was developed to fjrther stratify each 
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size commun-^ty. It was found that two important variables that measure 
socioeconofnic status - 0) median years of education of the population 
25 years and over dnd (2) median family income, in thousands of dollars - 
had similar variability. Therefore, these two variables were summed to 
form an index of socioeconomic status which served as a basis for 
stratification of communities within a size category. 

In order to compensate for incomplete administrations due to absences 
and other losses, weights were assigned to all raw score frequencies. Size 
of system, socioeconomic :>tatus, region, and public-parochial school balance 
were all considered in assigning these weights. The weighted distributions 
are believed to closely approximate those of the total population of students 
in the United States for each grade. 

The following tables display the results of this sampling procedure. 
The reader can compare the national norm sample of pupils with the general 
population figures for both the nation and North Carolina. Table 2 shows 
a comparison of the percentages of students in the weighted norm sample 
that are within each of the national regions. The corresponding population 
figures are shown for North Carolina and the United States. 



TABLE 2 

REGIONAL PERCENTAGES JN THE NORM SAMPLE AND 
THE TOTAL POPULATIONS OF N. C. AND U. S. 







R 


E G I 0 N S 






GROUP 


Northeast 


Midwest 


Southeast 


Southwest 


Far West 


Norm Sample 


21.4 


32.3 


19.9 


11.2 


15.2 


United States 
Population 


26.7 


29. 1 


18.8 


10.0 


15.4 


North Carolina 
Population 






100.0 
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Table 3 compares the percentage distribution of the students in the norm 
sample among seven community sizes with the percentages within these conmunity 
sizes in the nation and North Carolina. 



TABLE 3 

COMMUNITY SIZE PERCENTAGES IN THE NORM SAMPLE AND 
THE TOTAL POPULATIONS OF N.-C-. AND THE U. S. 

r 



Group 



1,000,000 



Norm Sample 

United States 
Population 

North Carolina 
Population 



spuiati 
(1970) 



9.7 
9.2 
0.0 



Lower Bounds of Community Size 



250,000 



100,000 



11.5 
11.5 
8.1 



7.7 
6.7 
23.2 



50,000 



25,000 



9.1 
8.3 
1.8 



8.5 
9.0 
8.2 



10,000 



10.5 
10.2 
6.4 



1-10.000 



42.6 
45.6 
52.4 



The socioeconomic categories within community size are not available 
from the test manuals, however, the socioeconomic index ranged from 7 to 27. 
This range can aid in the interpretation of Table 4 which compares the U. S. 
and North Carolina populations. 

TABLE 4 

MEDIAN YEARS OF EDUCATION AND MEDIAN FAMILY INCOME (IN THOUSANDS OF DOLLARS) 
JOR THE 1970 TOTAL POPULATIONS OF N. C. AND THE U. S. 



Group 


Median Education 


Median Family Income 


Socioeconomic Index 


U. 


S. Population 


12.1 


9.87 


21.97 


N. 


C. Population 


10.6 


7.77 


18.37 
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Although ethnic membership was not a factor in selecting or weighting 
of the norm group* estimates of the percentages in the norm sanfjle as well 
as the total North Carolina and the United States populations is given in 
the next table. 

TABLE 5 

ESTIMATES OF THE PERCENTAGE DISTRIBUTION WITHIN ETHNIC GROUPS 
IN THE NORM SAMPLE, THE NORTH CAROLINA SAMPLE, 
AND THE U. S. STUDENT POPULATION 















Group 


American-Indian 


Black 


Oriental 


Spanish/American 


White 


Norm Sample 


O.S 


15.7 


0.5 


4.0 


79.1 


United States 












Population 












(1968) 


0.4 


14.5 


0.5 


4.6 


80.0 


North Carolina 












Sample 


1.2 


29.0 






69.0 



These tables indicate that the norm sample is representative of the 
nation and there are significant demographic differences between pupils 
in North Carolina and pupils in the nation. 

Additional information about third graders in North Carolina and their 
environment is presented in the following tables. 
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TABLE 6 



PUPIL CHARACTERISTICS OF THE THIRD-GRADE ASSESSMENT SAMPLE 



Characteristic 




Sex 




. Male 


51.3% 


. Female 


48.5% 


Raciai/Ethmc Membership 




. American Indian 


1.2% 


. Black 


29.0% 


. White 


69.0% 


Parental Education Level 




. Neither over eighth 


5.9% 


. One over eighth 


25.9% 


. One high school graduate 


44.8% 


. One over high school 


23.5% 


Family Income Estimate 




. Less than $3,000 


15.4% 


. $3,000 - $15,000 


75.6% 


. Over $15,000 


8.1% 


Any Kindergarten Experience 




. Yes 


39.2% 


. No 


53.4% 


. Unknown 


6.8% 



No rth Carolina Comparisons With Other States 
Because learning does not stop at the end of the school day, it is 
helpful to review the environment in which this out-of-school learning 
occurs. North Carolina, the twelfth most populous state in the nation has 
been described as a "state of magnificent variety." The agriculture and 
industry of North Carolina are varied, with the state producing two-thirds 
of the country's flue-cured tobacco and leader in fabric and furniture 
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manufacture. Tourism also flourishes in North Carolina as thousands annually 
visit its mountains, parks, golf courses, shores, and sites for boating and 
fishing. Clea^iv, such di vers'^f ication makes it difficult to describe the 
"typical" North Carolinian. 

The diversity continues when such variables as individual income, 
occupation, ^ace, ana education are considered. These factors and the values 
placed on them vary not only by county and region, but within cormiunities 
as well . 

In studying educational status and change over time it is essential to 
examine achiev^ement in conjunction with environmental factors. Of these 
element:,, socioeconomic factors, in particular, are associated with 
educational opportunity and attainment, and these exert a major influence 
on a child's growth and develooment. Educators must consider these tangibles 
and, more importantly, the values and ethics implicit in a child's immed'ate 
environment. The remainder of this section will contrast the environment 
of the North Carolina pupil with the environment of pupils in other states. 

A state's population, size, and population distribution are basic 
environmenta; factors. The following tables show North Carolina's relative 
ranking. More detailed infomiatlon is included in the Appendix. 



TABLE 7 



NORTH CAROLINA'S RANK AMONG THE FIFTY STATfS 



ON BASIC DEMOGRAPHIC FACTORS 



Fac tor 



North Carolina's Rank 



Land Area (1970) 
Population (1973) 



29 
12 
17 
5 
6 
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People Per Square MMe (1970 ) 

Percentage Classified Rural (1970) 

Percentage Blatk (1970) 

Median Age (1970) 
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As evident he^e, North Carol v^a students are from a more populous 
state wnere the people are younge*", more 1^'kely to be of a minority group, 
and live in smal'e^ towns that, people fn most states. It also apparent 
that the degree o* "OMhty js twice that of the nacicna- a^efage wh;le 
the density is sl^ghtiy above average. 



TABLE 8 

NORTH CAROLINA'S RANK AMONG THE FIFTY STATES 
ON BASIC SOCIOECONOMIC FACTORS 





Factor 


North Carolina's Rank j 


Pe*- Capita Income (1972) 


34 


Households With Cash Incomes o^" 
$3,000 or less ('9?2) 


12 


Per FdniV income (1970) 


40 


Median reari ot Educat'-op (1Q70) 


4e 



North Carolina's students do not share in as much of the basic 
socioeconomK wea'ch as do students from other states. That is. North 
Caronnd 'd.ncs anong t^ie lowest ten states on important characte-'^i sties 
such as v»:o:7]e a^'^d edu'Tot'on -eve^ of aduUs. 

Thus, No^ih Caro^ na's como nation of factors associated wUh ^'ncome, 
ethnic composuion, degree ot ^u^^'itjy and aduH educatton level seem to 
indicate a "nor-tvp'cal" background fo^ he^^ youth. A picture emerges of 
an en.'^ronment wh^h 'Hiy not re^nfo^^ce max:muiTi educafonal progress, 

Cofr;p <3^ ':-rjns W^th^n No^th Carolina 
Just as ^nere a'^e st^^ong differences between North Carolina and tne 
average co.nposUe for th^ nat'on, the-'e a^e great variations with?n the 
state's bounda^^es Pa^t culcs^^y important is the variety which exists 
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with the differing traditions and personalities of its Mountain, Piedmont, 
and Coastal Plains groups. The following table describes some of these 
differences: 



TABLE 9 

GENERAL ENVIRONMENTAL FACTORS WITHIN NORTH CAROLINA 



Factor 


1 

Mountains 


1 

Piedmont 


Coastal 
Plains 


State 


Population 
(1970) 


760:760 
(15%) 


2,692,975 
(54%) 


1 ,628,323 
(32%) 


5,C82,059 


Growth 
(1960-1 970) 


11% 


21.3% 


7.7% 


11.5% 


Distribution of 
Black Population 
(1970) 


41,459 
(4%) 


569,575 
(51%) 


515,444 
(46%) 


1,126,478 


Percentage Black 
(1970) 


5.4% 


21.1% 


31.6% 


22.2% 


Percentage Classified 
Rural (1970) 


/5.1% 


45.9% 


60.6% 


55.0% 


Percentage That Moved 
(1965-70) 


40.5% 


46.0% 


49.2% 


46.2% 



Vnes? basio environmental factors indicate that a majority of the people 
ol:ick and wnUe - iive io tne Piedmont; the Mountains have the highest 
percentage of the people living In rural areas; 50d the Coastal Plains 
po»oulation his a greater proportion that is olack. Perhaps the major point 
in tnese figures is the /arJety oetwaen these three major geographical 
divisions. As disclosed earlier some of theso same variables have been 
Shown to be related no achievement. 
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Distribution of economic resources in these three regions also varies 
as the following table shows: 

TABLE 10 



SOCIOECONOMIC FACTORS WITHIN NORTH CAROLINA 













Factor 


Mountains 


Piedmont 


Coastal 
Plains 


State 


Family Income 


8,059 


10,234 


7,757 


9,139 


Family Income 
Female Head (1970) 


5,017 


5,620 


4,104 


5,017 


Average Percentage 
Free School Lunch 


35.2% 


37.6% 


64.7% 


47.8% 


Percentage Living 
Below Poverty 


20.2% 


15.1% 


28.8% 


20.3% 


Percentage of all 
Families Below Poverty 
with Children Under 18 


10.7% 


8.9% 


19.2% 


12.3% 


Pe^-centage of all Children 
Under 18 From Poverty 
Fami lies 


20.5% 


17.4% 


34.T»% 


23.6% 


Percentcge of Children 
Under 18 Living with 
3oth Parents 


82.6% 


80.1% 


73.7% 


78.3% 



Ssccuie jocioeconom'lc status is a strong predictor of academic success, 
regio.i^: i ffere.nces in educaTiiondl achievement are to oe expected. Thus, 
doy Qcodem:: co.nparisops should be carefully tempered by these background 
differences. 
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still another factor associated with academic achievement is the 
educational environment. Regional patterns are suggested in the table below: 

TABLE 11 

EDUCATIONAL FACTORS WITHIN NORTH CAROLINA 













Factor 


Mountains 


Piedmont 


Coastal 
Plains 


State 


Average of Median Years 
of Education - Adults 
Over 25 




9.5 


10.2 


9.9 


10.6 


Adult Education Index 




2.50 


2.82 


2.56 


2.69 


Percentage of High School 
Graduates of Those 16-21 
Not In School 




49.7% 


48.7% 


44.0% 


46.7% 


Taxing for Education 
Index 




417 


507 


439 


478 



These environmental, socioeconomic, and educational factors are a major 
influence on a child's educational growth and development. Educators who 
consider regional comparisons must be aware of the differential effects 
that these factors contribute within regions. Certainly, expectations are 
better determined with an awareness of the status of these variables 
irrespective of whether local, regional, or state comparisons are being 
made. 
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LANGUAGE ARTS INSTRUMENTATION 



In this section, specific detail on both the norm-referenced and 
objective-based tests is discussed. Highlights of the report and the actual 
results will be presented following this section. 

Norm- Referenced Test 

The language section of the norm-referenced Iowa Tests of Basic Skills 

(ITBS) provides an indication of N. C. third-grade student performance in 

relation to certain language skills of third-grade students in the nation. 

These skills are grouped into four subtests designed to measure the 

essentials of effective written communication: spelling, capitalization, 

punctuation, and usage. Test results will be presented by four subtest scores 

and a total language score. The types of items, or tasks, involved in each 

subtest are as follows: 

Spel ling : Each item consists of three different words, one of 
which is misspelled. The three words are presented 
orally in the context of a sentence, and the student 
must mark the misspelled word in his test booklet. 

Capitalization : Several short paragraphs are presented without appro- 
priate capitalization. The student must mark (underline) 
the first letter of any word that is not properly 
capitalized. 

r uncUio 'tion:^ Th:^ ron aL of L'lc punc Luc Lien siihLosL is r.iiiiilar to thot 
of capital! /olion. ['ach paranrapii deals wi Lh one specific 
punctuation mark. The student must mark the spaces whore 
the designated punctuation mark is missing. 

Usage : Items on the usage subtest are presented in written 
form in the test booklet but are administered orally. 
Each item consists of three sentences, and the student 
must select the best sentence. The other two sentences 
contain at least one common mistake in oral or written usage. 

Objective-Based Test 

General Description 

The object! ve- based language arts test administered in the 1973-74 
assessment of third graders was experimental in nature. It attempted to 
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identify specific strengths and weaknesses of students in one skill area, 
punctuation, across four learning modalities: (1) Listening, (2) Speaking, 
(3) Reading, and (4) Waiting. Punctuation was selected, not because it 
was considered more important than other language areas, but because 
more straight- forward items could be developed to measure the conceptual 
framework. Students were also asked questions concerning basic concepts 
or rules of punctuation under a fifth category. Recognition of Information. 

Ten punctuation skills (or objectives) were selected. Briefly, these 
were the use of: 

1. the period as terminal punctuation 

2. the question mark as terminal punctuation 

3. the exclamation point as terminal punctuation 

4. commas to separate words in a series 

5. corrmas between city and state 

6. commas in the date of the year 

7. the apostrophe in contractions 

8. coirmas after the greeting of a letter 

9. commas after the closing of a letter 

10. quotation marks before and after a direct quotation 

Items for the first four punctuation skills were developed for all four 
modalities of learning. Due to the limits of test length, emphasis was 
placed on these first four skills. Items for skills 1 through 3 and 5 
through 10 were developed for the Recognition of Information or rules 
category. The reading modality contains items for all ten skills. 



22 



ERIC 



33 



TABLE 12 

Conceptual Scheme for Objective-Based Punctuation Test 



Punctuation Skill 



Category of Assessment 



Period 



Listening Speaking 

Listening Speaking 

Listening Speaking 

Listening Speaking 



Reading Wntinq {^ v^avs) 

Reading Writing (J wa>s) 

Reading Writing (3 ways) 

Reading Writing (3 ways) 



Recognition of InfuniMtuin (Rule<;) 
Recognition of InformatUHi (Rulps) 
Recognition of Information (Rules) 



Question Mark 
Exclaration Point 
Commas (Series) 
Cofnnas (City, State) 
Commas (Date, Year) 
Apostrophe 

Comma (Letter Greeting 
Coitina (Letter Closing) 
Quotation Marks 



Reading 
Reading 
Reading 
Reading 
Reading 
Reading 



Recognition of Information (Rules) 

Recognition of Information (Rules) 

Recognition of Information (Rules) 

Recognition of Information (Rules) 

Recognition of Information (Rules) 

Recognition of Information (Rules) 



Rationale 



Current philosophy in the language arts area indicates that listening, 
speaking, and writing should be integrated into one program. However, there 
are few available suggestions in print for accomplishing this task. Little 
is known about how children actually learn language skills, and the exact 
relationships among these four learning modalities in language usage are 
unclear. For example, do children learn to recognize the intonation 
patterns appropriate for asking questions before they can reproduce those 
same patterns in their speech ? Do they in turn use that skill to read 
questions with correct intonation and to write the symbols that indicate 
that pattern? Are these modalities hierarchical or do they develop '*all 
of a piece"? Or are learning styles only individual? 

This experimental objective-based test on punctuation was directed 
toward these and other questions. Can third graders use information they 
have about punctuation in listening, speaking,, ^^eading, and writing tasks? 
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Can they 

- recognize rules of punctuation? 

- hear and identify oral language? 

- reproduce the appropriate intonation patterns in speaking? 

- identify correctly and incorrectly punctuated sentences 

when those sentences are read? 

- write sentences using the appropriate punctuation symbols? 
Item Types 

Items for the five different categories were necessarily of differing 
types. Recognition of Information dealt with the knowledge of rules of 
punctuation. The Listening modality consisted of items requiring the 
student to listen for the correct punctuation. The Speaking modality items 
involved the reading of sentences with the correct voice inflection, as 
indicated by the punctuation, Reading items were in a multiple choice 
format, with the student instructed to read by himself and choose the 
correctly punctuated sentence. There were three types of items under the 
Writing modality, each designed to assess one level of the student's ability 
to write using appropriate punctuation. These levels were: 

A, supplying the correct punctuation for a sentence already written 
in the test booklets 

B, writing a dictated sentence and supplying the correct punctuation, 

C, creating his own sentence, using the designated punctuation correctly. 
For more detailed description of the tasks involved and examples of item types, 
see Appendix, page 67, 
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lANuUAGE ARTS HiaHLlGHT> 



^wc :/pe> of language a^ts te^^i we-e adm^n* sieved in tne 1973-74 State 
Assessment of Educat^ood! PDgre^s ^ No^th Ca^o^'na ihe Iowa "^ests of Basic 
Sk^'ls pe^.Tiirted no^.ii-'^efe''encea :ompa'' >sons betneen a nat'onal no^m group and 
a sanipie or NoTh Ca«^o'^na s trrrd g.^ade^v A^ e<^pe" mental object we-based 
Punctuation Test was a'so adu- n* ?.te^ed \o z sample tn^^d grade^^s ui an 
attempt to dete^Ti'ne how students 'ea'^o langjage sk^' s as we'-^ as to pinpoint 
strengths a^-d -veaknes^e: amo 59 ^c-e^. ^'^'u langjage s< ' 

The ITBS tested four b'^oad langjage a.'t> ski^^ areas: spewing, capital- 
ization, pun:tjation, and usage No^^th Ca^o^ina's th^ ^d-grade pei^formance was, 
on the ave'^age, below the nation on the rota" language score Average subtest 
score compansD^s we^e quite var^^abie wHh Noah Carolina s th^^d grader's 
average scopes bemg sl'ghtV above the national average -n spelling, somewhat 
below ^n puo'i/uat-on a'^d capnaJ zation, and considerably -owe"^ ^n usage- 

Detd' ^ed «nfo**mat^on on the composUion of the nationaMy normed group 
and North Ca'^oiina^s th-^d graders indicates strong differences exist and that 
compar-ison^ Detween "he groups should be done w^th care Stat st^cans suggest 
that no one njube*' ran express the degree of any difference between the two 
groups and '-ne^efo^e se^e^^al ^epoa^ng systems should be considered, One system 
reveals ^hat tne nat'ona' normed g^oup genp/^aHy has a fou*^ to five month greater 
grade-equ va'ent average sco-^e than does tne state g^Dup D'v'd:ng the two score 
distribu^ orb 1 nto nte'*/ais ""e^eal^^ a d* ^pr-opoi^t-onate numoer of North Carolina 
students n the lowest intervals ^her\ compared with the national g«^oup, while 
the m:ddle icore inte^«a'S have about the same percentage of North Carolina and 
nat^onai ne«^fli studen::- Another system suggests ^hat >f the two groups we*^e each 
represented oy jre hundred students, the'^e soj^d be ten to twe'^e more norm-group 
students w th h ghe^ c^es tha-^ No'^th Carolina students at any score on the 
d^; st"^ ibut'On of s:ores 

On the expp' ^Tie- '3 ' Pj^-ituat^on Test, Noah Ca^O'-na th'^d g^ade^s performed 
as gene^^aHy expected oy th^'-d-g'^ade teacher's Spec f »cany» the -esuits show: 

^hct ^tud-"' achievement was highest for punctuation skip's ^nvolv^ng 
*he pf' :d, ^oi'cwed :1ose''y by the exi'amation pomt and question 
m-<, Af tn Doo'e-t- -eiuits be^ng po^^ted to- u^'-^g commas to separate 
wo-'d*: • n a se*' ^e>; 

that ^ con>'s^e^'t h e-a^chy of moda'^t^e-: of 'ea-^p^ng (Read*ng, 
Speaking, ^^emng, and W'''t^ng^ d*d not emerge ecro^iS a'l punctua- 
t»Dr ^k'^i^ asse^^ed Howe-e«^, Wr-t^ng gene^'a '.y appeared to be 
^he mos^' d'f^'c/i^ moda'^^y fo^ us^ng mo'^e advanced punctuation 
sk^^'ic ,n the th>r d-g^adf^ cu ^'Cu-um 

that actual arhiei/ement Dy the tm^-d-gMde students in the Wruing 
tasks wa-^ sVghtiy ^owe*" than the teacher's e^tpected 

and ':hat student punctuat-cn pe^^fo^'oiance was no lowe*' when students 
created tre^^ own sentence- In fact, the students f^^equently used 
iDQi^e d'**'cuU word? corvee t'y and ^nvoUed mo^e d^ff^cu't structural 
patterns in produc ng tner own sentences than were used in d'ctated 
sentences 
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LANGUAGE ARTS: DETAILED DESCRIPTION OF RESULTS 
Results on the norm-referenced and objective-referenced tests will 
described in detail in th*is section of the report. As indicated m 
t^^'O discussion of data interpretation, the no'^m-refe^^enced data (comparing 
North Carolina with the national third graders) should be examined through 
several systems: grade equivalent, percentile rank, item difficulty, 
end distribution comparisons. The combination of these sources provides 
a more complete picture. 

Norm-Referenced 

State comparisons with the national norm group will precede the three 
. egional-state comparisons of this section. Information about performance 
rtitmn certain categories on variables such as sex and education level of 
oarents will be included in both the state and region-state sections. 

State-National Comparisons 

nrdi de Equivalent 

The grade equivalent estimates where the "typical" North Carolina 
Tiird grader is along the development continuum, as measured by the 
: terns on this test. In order to use this concept, the grade equivalent 
estimated for the representative national sample at the t me of year 
when our students were tested was determined. Wn^le skill development, 
ds measured by this concept, is not necessarily uniform across actucl 
T/vfiths in school, the value which grade equivalent would assign to the 
reo an (average) students score for the penod when North Carolina's 
third graders took the test is 38.0. Comparisons between the North 
Cd'^olina results and the national norms may be made by use of the follow ng 
:jbie: 
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TABLE 13 



NORTH CAROLINA AND NATIONAL NORM 
RESULTS FOR LANGUAGE ARTS (ITBS) 



Basic Skin Area 



Middle or Average Score 
North Carolina National Norm 



Language Arts 
. Spelling 
. Capitalization 
. Punctuation 
. Usage 
. Total 



38.9 
33.3 
34.1 
28.1 
33.6 



38.0 
38.0 
38.0 
38.0 
38.0 



Differences at the middle or average score range from a national 
advantage of 9.9 in usage to a North Carolina advantage of 0.9 in spelling. 
When using the average as a reporting statistic, it is important to remember 
this figure represents the center of a wider distribution of scores. When 
this distribution of scores for the third-grade sample are divided into 
intervals based on national percentages, it is evident that some North 
Carolina students scored as high as some students in the national norm 
sample. The following table contains intervals which were established 
in reference to the national norm group. The first and last intervals 
were set at nine percent and the second and fourth were set at twenty 
percent with the balance of forty-one percent placed in the middle inter- 
val . After the range of scores had been resolved for the percentage of 
students who fell into these intervals in the national norm group, the 
percentage of students in North Carolina who had these scores was 
determined. 
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TABLE 14 

COMPARISON OF NATIONAL AND NORTH CAROLINA SCORE INTERVALS 
IN LANGUAGE ARTS TOTAL SCORE (I TBS) 



Label 


Percentage of Students 
National N.C. 


Grade Equivalent 
Range 


Much Above Average 


9 


3 


56-65 


Above Average 


20 


17 


45-55 


Average 


41 


35 


31-44 


Below Average 


20 


18 


25-30 


Much Below Average 


9 


26 


13-24 



These labels are suggestive of how the students performed in comparison 
with their peers. They do not suggest that students are not working 
to their potential. It is likely that the "much below average" group 
is making a best effort as is the "much above average" group. Thus, 
the table reflects not only that every student cannot be "average" but 
also that there will be fundamental differences in individual ability 
when peers are compared. 

The comparison where percentage of students fall into the five 
intervals suggests that a greater proportion of North Carolina students 
scored in the lowest interval than students from the national sample. 
Certainly, this is not unexpected due to the implications of the 
differences in supportive environmental factors discussed earlier. 
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TABLE 15 



PERCENTAGE OF NORTH CAROLINA AND NATIONAL STUDENTS IN 
GRADE EQUIVALENT INTERVALS FOR LANGUAGE ARTS TOTAL (ITBS) 



Area 


1.0-1.9 


Grade Equivalent Intervals 
2.0-2.9 3.0-3.9 4.0-4.9 


5.0-5.9 


6.0-6.9 


N.C. 


10.1 


31.0 


26.8 


20.6 


10.3 


0.9 


Nation 


2.0 


25.0 


31.0 


22.0 


14.0 


5.0 



The above table demonstrates the same points on distribution of scores 



and the greater proportion of higher scoring students in the national norm 
as does Table 14. The first table, based on an arbitrary choice of per- 
centages, also indicates through the grade equivalent ranges, that finer 
distinctions are possible in the lower intervals. This finding is 
probably due to more items in lower level skill development on this test. 

A greater percentage of this state's third graders fall in the lower 
intervals for capitalization, punctuation and usage than the students of 
the national norm group. Spelling results, however, show a greater 
proportion of North Carolina students in the higher intervals than the 
national sample. Again, it is impo'-tant to note that students scored 
across the entire range of possible scores and that many scored in each 
interval. The average or middle score, therefore, reflects a central 
point in the score distribution and will be lower or higher in future 
years as the relative proportion of higher scores decreases or increases. 
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Percentile Rank 

Another system of examining the state results is in relation to national 
student percentile norms. The following table describes the percentages of the 
national and North Carolina student groups who have scores equal to or higher 
than the score shown in the left column. (These scores were chosen as generally 
representative of the five intervals shown in Table 14). Because the percent- 
age of students will accumulate as the scores increase, the relative change in 
percentage of students from the previous score is shown for each score as well. 



TABLE 16 

PERCENTILE INFORMATION ON CAPITALIZATION 



Selected 
Grade Equivalent 
Scores 


Cumulative Percentage Of 
Students Having Scores Equal 
To or Lower Than the Score 


Relative Change In 
Percentage of Students 
From Previous Score 


North 
Carol ina 


National 
Norm 


North 
Carol ina 


National 
Norm 


13 


3.4 


1 


3.4 


1 


24 


30.3 


14 


26.9 


13 


30 


44.8 


29 


14.5 


15 


38 


63.0 


50 


18.2 


21 


44 


76.6 


66 


13.6 


16 


54 


96.3 


84 


19.7 


18 


66 


100.0 


100 


3.7 


16 



This data suggests two points. First, by subtracting the cumulative 
percentage cf norm students from the percentage in the North Carolina group 
at each score (e.g., at score 44, 76.6 (N.C.) - 66 (national) = 10.6) we note 
that 10-12 more norm-group students (out of any representative 100) have 
higher scores than any representative group of 100 North Carolina third 
graders at any score on the distribution of scores. Secondly, a similar 
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relative change in percentages of students from previous scores is evident 
for the N. C. and national norm groups after the percentage changed from a 
score of 13 to a score of 24, For example, at score 30, the relative change 
from a score of 24 to a score of 30 is 14,5 for N- C- and 15 for the nation. 
These similar changes suggest an equivalent proportion of tudents in each 
group with scores in the intervals earlier labeled (Table 14) below average 
(scores 25-30), average (31-44), and above average (45-55), Additional 
information can be gleaned from the percentile rank through comparing a 
North Carolina student using the state averages as his scores on each sub- 
test to the national norm percentiles. The percentage of students with 
scores falling at or below his score in the national group would be: 
spelling (55%), capitalization (40%), punctuation (41%), usage (28%) and 
total language arts (40%), These results using the percentile rank shed 
additional light on degree of North Carolina-National differences and confirm 
the state's generally higher performance in spelling as well as the national 
generally higher performance in capitalization, punctuation, and usage. 

Item Difficulty 

Student responses to the individual items on the several language arts 
subtests were also analyzed. Here a percentage comparison of the national 
norm group and N. C, third graders who answered the items correctly revealed 
the same directional patterns as those occurring in the grade equivalent and 
percentile rank. That is. North Carolina had a higher percentage than the 
national norm group who answered the spelling items correctly. Punctuation 
items were more evenly distributed, but the total count revealed more items 
on which norm group students demonstrated a greater percentage with correct 
answers. North Carolina student performance in capitalization revealed more 
items below the national student percentages while usage, the lowest subtest, 
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contained no items with better North Carolina performance. The distribu- 
tion of differences between percentage of correct responses for the 
national norm qrouD and North Carolina's third graders is shown in Table 
17. The table presents the number of items fallinq into each of the 
five percentage point intervals above or below the zero interval. Zero 
Dn this table indicates no percentage difference between the state and 
norm groups answering an item correctly. Therefore, the interval 
1 to 5 will contain these items in which the percentage of N. C. 
students answering the items correctly exceeds the national norm percent- 
age of correct responses by 1, 2, 3, 4, or 5 percentage points. Con- 
versely the -1 to -5 interval will contain the items where the national 
percentage exceeded the N. C. percentage correct by 1, 2, 3, 4, or 5 
percent. All intervals with minus signs will contain items then in 
which a greater proportion of the norm group answered the item 
correctly. 
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TABLE 17 



DIFFERENCE IN PERCENTAGE ANSWERING ITEM 
CORRECTLY BETWEEN NORTH CAROLINA AND NATION 



iPercentaqe Difference 
• Between N C and II 


Number of Items 


Soel 1 inn 


Capitan- 

y^^i" inn 


Punctu- 

a L 1 un 


I'Sdge 


1 Ota 1 


16 to 20 


0 








2 


11 tn IR 


A 
t 




0 
0 




7 


fi tn in 

U LU 1 U 


8 


6 


5 




19 


1 to 5 


4 


9 


17 




30 


Zero 




5 


1 




6 


-1 to -5 


7 


32 


16 


6 


61 


-6 to -10 


4 


17 


20 


7 


48 


-11 to -15 




4 


5 


5 


14 


-16 to -20 




2 


1 


3 


6 


-21 to -25 








1 


1 


-26 to -30 








1 


1 



This table suggests a national overall advantage but also suggests 
a possible pattern of state strengths and weaknesses at the item level. 
The national norm and state pattern of percentage answering each item 
correctly for the ounctuation subtest is illustrated in Figure 4. 
(Figures for all subtests are contained in the Aooendix as Figures 2 - 
5.) The pattern of North Carolina responses is very similar to the 
national pattern on all subtests. Where the nation's students appeared 
to be stronger or v/eaker, North Carolina's students generally were also 

Stf'Ongci* or Weaker*. 
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Ine degree of difference at the item level between this state and 
:he national norm grouD suggests the oercentaae difference in correct 
answers varies greatly by subtest. When all items are considered this 
difference is generally in the area of 10 to 12 percent. 

The scores of students in North Carolina were analyzed by classi- 
fication variables such as education level of parents, estimates of 
"amily income, and a two-way classification of jex by the two major 
othnic groups within this state. Results from these breakdowns are 
reported in the next sections. The reader is again reminded to avoid 
simplistic cause-effect explanations from group membership alone. 
Membership in the classification groups may be simply a manifestation of 
nany other factors and the purpose here is only to describe any differ- 
once which may exist. 

State Results on ITBS According to Parental Education 

Student scores were classified by the following four parental edu- 
cation levels: 

1. Neither parent had more than an eighth grade education. 

2. At least one parent attended, but did not complete high school. 

3. At least one parent completed, but did not go beyond high 
school . 

4. At least one parent has some education beyond high school. 
The average score for all subtests sequentially increases as the 

parents' education level increases. Grade equivalents for each subtest 
and the language total by education level are presented in Table 18. 
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TABLE 18 



GRADE EQUIVALENT AVCR^GES FOR ITBS LANGUAGE 
BY PARENTS' EDUCATION LEVEL 



North Carolina Parents' Education avel 



ITBS 
Language Areas 


Neither 
Over 8 


At Least One 
Parent 
Over 8 


At Least One 
High School 
Graduate 


At Least One 

Over 
High School 


Spel 1 ing 


31 .5 


34.1 


^0.7 


45.3 


Capitalization 


25.4 


27.7 


35.5 


40.8 


Punctuation 


26.5 


29.1 


35.6 


41 .9 


Usage 


20.4 


22.9 


28.2 


38.1 


Language Total 


26.1 


28.5 


35.0 


41.5 



The pattern of state language strengths and weaknesses in com- 
parison with the national norm group is not affected by level of parents' 
education. That is, spelling is the highest subtest within any educa- 
tion level and is followed by punctuation and capitalization with usage 
noticeably lower. 

Figure 10 illustrates the pattern of averages for total language on 
the ITBS. (Figures 6 - iO in the Appendix reveal the pattern for all 
subtests.) This figure visually demonstrates the sequential increase 
in average subtest scores with each education level as well as the 
relationship of subtest averages to the state and national averages. 
Comparisons of subtest averages to state averages within each level of 
parental education reveal a range of differences from 7.4 to 7^9 grade- 
equivalent months below for level 1, 4.8 - 5.6 below for level 2, 0.1 - 
2.2 ahead for level 3, and 6-4 - 10.0 ahead for level 4. 
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When compared to the national average, the language subtest scores 
for levels 1, 2, and Z are all lower, with the exception of spelling in 
level 3. The scores for level 4 all exceed the national average. The 
degree to which subtest scores differ from the national average vary 
considerably within each parental education level. However, spelling 
demonstrates the most favorable relationship to the national average; 
usage is always least favorable. 

Figure 26 illustrates the span of scores for language total on 
each parental education level. (Figures 22 - 26 in the Appendix illus- 
trate this data for all subtests.) The graph shows the mean for each 
parental education level, state means, and national means, as well as 
the full range of scores. These ranges illustrate the previous point 
that the mean does not reveal the complete picture. It should be noted 
that some students in levels 2, 3, and 4 obtained scores in the sixth 
grade equivalent range while level 1 indicates scores as high as the 
fifth grade equivalent range. Ai the lower end of the range, the 
difference in scores between levels was very small. Thus, there are 
students in each classification group who scored about as high or as low 
as any students in the other groups with which they are compared. The 
differences in education level averages is caused by the greater pro- 
portion of higher scoring students in the upper parental education 
levels. 

State Results on ITBS According to Family Income 

Scores were also analyzed by a teacher estimate of three levels of 
annual family income. These levels and the percentage of North Carolina 
"sample" students falling into each level are: 
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1. Less than $3,000 Fifteen percent of sample students 

2. $3,000 - $15,000 Seventy-six percent of sample students 

3. Above $15,000 Eight percent of sample students 

Results by grade equivalent averages for each level and all lan- 
guage areas is presented in Table 19. 

TABLE 19 

GRADE EQUIVALENT AVERAGES FOR ITBS LANGUAGE 
BY FAMILY INCOME LEVEL 



ITBS 
Language Area 


North Carolina Family Income 


Level 


Less Than 
$3,000 


$3,000 - $15,000 


Over $15,000 


Spell ing 


33.3 


39.2 


47.0 


Capital ization 


25.7 


33.9 


42.9 


Punctuation 


27.4 


34.5 


44.0 


Usage 


21 .3 


27.9 


43.0 


Language Total 


27.0 


33.9 


44.2 



The average score for each subtest increases sequentially as family 
income interval increases. Figure 15 on total language displays the 
pattern of averages for each family income level as well as the relation- 
ship of subtest averages to the state and national averages. (Figures 
11-15 included in the Appendix indicate this relationship for all 
subtests.) The pattern of scores within each level of family income is 
similar to that of the total state scores, with spelling the highecc 
average c:nd usage the lowest average for any subtest. Averaoc scores 
from the classification $3,000 - $15,000 are close to the state average 
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across all language areas. Level 1 (less than $3,000) average scores 
^-ange 5 6 to 7.6 behind the subtest state averages, and Level 3 averages 
{more than $15,000) exceed the state averages by 8.1 to 14.9. 

All subtest average scores for levels 1 and 2 fall below the 
lational average, with the exception of spelling in Level 2, which ex- 
ceeds the nation. The degree to which subtest average scores differ 
from the national average vary considerably within each family income 
level. However, spelling averages demonstrate the most favorable re- 
lationships to the national average while usage averages are usually 
least favorable. 

Figure 26, on page 38, shows the full ranre of scores for language 
total on each level of family income. (Figures 23 - 27 are contained in 
the Appendix and illustrate this data for all subtests.) While students 
from the $3,000 - $15,000 and less than $3,000 levels show slightly lower 
average scores on some subtests it the lower end of the range of scores, 
all three income levels contained students scoring equally high on many 
subtests, it IS of some interest that the highest scores were in the 
53,000 - S15,000 level. However, the main point suggested by these 
figures is that there are students in each family income classification 
^ho scored aoout as hiqh or as low as any students in the other income 
qrouDs. As discussed previously, the differences in family income 
averages are caused by the greater proportion of higher scoring students 
m the upper family income levels. 
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state Results on IT6S According to Sex and Race 

When the students were classified into the four categories of black 
boys, biack giris, white boys, and white girls» the girls had consis- 
tently higher average scores in all areas of the ITBS language than did 
the boys in their respective races. Table 20 presents the grade equiva- 
lent averages for each level of sex and race for all language areas. 

TABLE 20 

GRADE EQUIVALENT AVERAGES FOR ITBS LANGUAGE 
FOR STATE BY RACE AND SEX 



ITBS 
Language Area 


Race and Sex 


Black Boy 


Black Girl 


White Boy 


White Girl 


Spelling 


31 .5 


37.0 


37.6 


44.5 


Capital ization 


24.6 


28.7 


33.3 


39.3 


Punctuation 


25.5 


29.1 


34.1 


40.2 


Usage 


20.9 


22.6 


29.4 


32.6 


Language Total 


25.6 


29.4 


33.6 


39.2 



The differences in score averages between boys and girls on the 
various subtests were greater for whites than blacks. The smallest dif- 
ference in averages between sexes for both races was in usage while the 
greatest was in spelling. As evident in Figure 16, the pattern of aver- 
age subtest scores for boys and girls in both races followed that of the 
total state averages, with spelling high and usage low. 
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Figure 26, on page 33, shows the full range of scores for language 
total for all boys and girls as well as for the ethnic membership 
classes of black, other, and white. (Figures 22 - 26 are contained in 
the Appendix and illustrate this data for all language students.) The 
upper and lower scores are very similar for all sex and race classifi- 
cations. Therefore, as earlier observed, there are students of each 
sex and race grouping who score about as high and as low as any student 
in the other sex or race groupings. The differences in sex and race 
averages are due to the greater proportion of higher scoring students in 
the girl and white groups. 

Regional Results on the ITBS Language 

Coastal Plains Region 

Grade equivalent average scores for the Coastal Plains and state 
are in the following: 



TABLE 21 

GRADE EQUIVALENT AVERAGES FOR ITBS LANGUAGE 
BY THE STATE AND COASTAL PLAINS REGION 



Area of 
the States 




ITBS Language Area 




Spell inq 


Capitan- 
zation 


Punctu- 
ation 


Usage 


Language 
Total 


Coastal Plains 


38.6 


32.3 


33.4 


26.7 


32.8 


Total State 


38.9 


33.3 


34.1 


28.1 


33.6 
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Again, the pattern of average scores is the same as the state's 
pattern. Spelling is very close to the state average and the highest 
Subtest. However, the state subtest averages exceed the Coastal Plains 
averages by 0.7 in punctuation, 1.0 in capitalization, and 1.4 in usage. 
Examination of the total language averages shows a state advantage in 
averages of 0.8. 

Black and white girls in the Coastal Plains consistently average 
higher scores than black and white boys respectively. The differences 
based on usage averages between sexes is similar for both races but the 
difference between averages on the other language areas is greater for 
whites than blacks. The following table contains the actual averages 
for these groups while Figure 17 in the Appendix illustrates the state- 
Coastal Plains averages and Figure 18 in the Appendix illustrates the 
sex and race averages for the Coastal Plains. 

TABLE 22 

GRADE EQUIVALENT AVERAGES FOR ITBS LANGUAGE 
FOR COASTAL PLAINS BY SEX AND RACE 



ITBS 
Language Area 


Race ani 


i Sex 


Black Boy 


Black Girl 


White Boy 


White Girl 


Spelling 


33.5 


39.0 


36.6 


44.5 


Capital izati on 


24.8 


30.2 


32.4 


39.9 


Punctuation 


26.0 


30.5 


33.8 


41.2 


Usage 


20.2 


23.6 


29.2 


32.4 


Language Total 


26.2 


30.9 


33.0 


39.5 
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Piedmont Region 

The Piedmont and state grade equivalent averages were as follows: 

TABLE 23 

GRADE EQUIVALENT AVERAGES FOR ITBS LANGUAGE 
BY THE STATE AND PIEDMONT REGION 



|Area of 
(The State 


ITBS Lanquaqe Area 


Spelling 


Capitali- 
zation 


Punctu- 
ation 


Usage 


Language Total 


i Piedmont 


38.4 


33.0 


33.9 


28.6 


33.5 


j Total State 


38.9 


33.3 


34.1 


28.1 


33.6 



Because most students reside in the Piedmont area, many of the 
state result patterns will reflect the Piedmont trends. Thus, it is not 
surprising that the language subtests averages will be the same as for 
the state, where spelling leads and usage is last. 

When stuaents are classified by sex within race. Piedmont girls' 
score averages are higher than the boys', for the same race. The differ- 
ence between the score averages for boys and girls on individual subtests 
is greater for whites (3.5 to 6.7) than for blacks (0.2 to 5.1) — a 
trend true for the state. The greatest differences between the aver- 
'jges for both sexes of both races is in spelling, and the least is 
usage — also similar for the state. Table 24 contains this Piedmont 
data and Figures 19 and 20 in the Appendix illustrate the Piedmont and 
state averages as well as the sex and race averages. 
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TABLE 24 



GRADE EQUIVALENT AVERAGES FOR ITBS LANGUAGE 
FOR PIEDMONT BY SEX AND RACE 



ITBS 
Language Area 


Race and Sex 




Black Boy 


Black Girl 


White Boy 


White Girl 


Spell ing 


29.9 


35.0 


37.5 


44.2 


Capital ization 


24.5 


27.0 


33.3 


38.6 


Punctuation 


25.3 


27.8 


39.0 


39.5 


Usage 


21.4 


21 .6 


29.6 


33.1 


Language Total 


25.3 


27.9 


33.6 


38.9 



Mountain Region 

Mountain and state grade equivalent averages are presented in the 
following table: 

TABLE 25 

GRADE EQUIVALENT AVERAGES FOR ITBS LANGUAGE 
6r THE STATE AND MOUNTAINS REGION 



Area jr 


ITBS Language Area 




Capital i- 


Punctu- 




Language 


Trie iCdie 


Spel ling 


zation 


ation 


Usage 


Total 


Mountains 


41 .6 


36.7 


36.9 


29.6 


36.2 


Total State 


38.9 


33.3 


34.1 


28.1 


33.6 
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These averages indicate a mountain advantage on each area of the 
language test. The total language difference between state and Mountain 
averages is 2.6 grade-equivalent months based on a difference in spell- 
ing averages of 2.7, capitalization -- 3.4, punctuation — 2.8, and 
usage — 1.5. Furthermore, the best mountain performance, based on 
averages, is in spelling followed by punctuation, capitalization, and 
usage — which is also true for the state. Figure 21 in the Appendix 
illustrates this point. 



49 



Objective-Based 

In this section, the data obtained from the objective-based assess- 
nent in language arts will be presented. As discussed in the section on 
'Language Arts Instrumentation," the purposes of the norm-referenced and 
objective-based tests are complementary. The norm-referenced ITBS pro- 
vides an indication of North Carolina's third-grade students' performance 
in certain broad language skills in relation to a national third-grade 
norm group. The objective-based test in language arts was experimental 
in nature and attempted to identify specific strengths and weaknesses of 
students in one broad language skill area, punctuation, across four 
learning modalities: (1) Listening, (2) Speaking, (3) Reading, and 
(4) 'writing. A discussion of state results will be preceded by a review 
of the special testing necessary for this area. 

Description of Sampling and Field Procedures 

The written portion of the experimental punctuation test contained 
items for three of the modalities or categories of assessment and was 
taken by approximately 2,500 students using the procedures described 
earlier. Items for Recognition of Information (Rules), and for the 
i^eading and Writing modalities were included in this portion. 

The Listening and Speaking modality items involved tasks requiring 
small groups and individual administration. Therefore, a special sub- 
sample of 450 students was selected from 2,500 students. Administrators 
were specially trained in Raleigh to test this group of students. 

Because these 4d0 were the only students who completed all test items 
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in the four modality and the Rules areas of assessment, comparisons 
across these areas must be done with care. Results of the subsample 
performance on the written areas (Reading, Writing, and Recognition of 
Information) were quite similar to the total sample, as evident in Table 
26 in the Appendix. (Here subsample results are shown in parenthesis 
below the percent correct on test items taken by the total sample and 
the subsample.) Due to this similarity, it is felt that the subsample 
performance on the Listening and Speaking items is basically representa- 
tive of the total sample. 

State Results 

The conceptual framework for the punctuation test requires that 
reporting be broken into two areas: modality of assessment and punctua- 
tion skil 1 area. 
Modality of Assessment 

Table 27 in the Appendix indicates the percentage of students cor- 
rectly answering a given number of the possible number of items for the 
modal Uies of Listening (8 items). Speaking (8 items), Reading (20 items) 
and Writing (4 items in each of 3 areas) as well as the area assessing 
Recognition of Information - Rules (9 items). When considering the 
results from these categories, it should be remembered that there are 
different numbers of possible items for each of the areas. 

Information contained in this table indicates that one half of the 
items were answered correctly by over two-thirds of the students. Thus, 
in Recognition of Information (Rules), 67% of the students answered cor- 
rectly over half the items, Reading--71%, and in the three levels of 
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Writing 70%y 70%, 68/0. Higher percentages of students answering over 
half the items correctly were found for Listening (90%) and Speaking 

(83^;). 

When the standard is raised to the percentage of students who an- 
swered three-fourths of these items correctly, the results were fairly 
consistent, with Recognition of Inforniation--49%, the three Writing 
levels 53%, 54%, 52%, and Speaking— 51 %. Reading had the lowest punc- 
tuation achievement level of 36%, while Listening was highest at 65%. 

When the standard is raised to achievement of a correct response to 
all of the items in a given category, more variation is noted. Two fac- 
tors should be recalled when evaluating these results. The first is that 
the number of Uems does vary by modality and the second is that the mo- 
dality of Reading and the area of Recognition of Information (Rules) 
assessed more punctuation skills than the other modalities or categories 
as was shown in Table 12. The results are presented below in order from 
highest to lowest percentage of correct answers to all items. Because 
variation at this standard appears to be related to number of items, this 
inforir.ation is also in luded in Table 28. 
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TABLE 28 
PERCENTAGE ANSWERING ALL ITEMS 
CORRECTLY IN EACH MODALITY OR CATEGORY OF ASSESSMENT 



Modality or Category 


Number of Itenis 


P*. centage All 






Correct Answers 


Writing-Dictated Sentences 


4 


29 


Writing-Created Sentences 


4 


29 


Wri ting-Already Written Sentences 


4 


28 


Recognition of Information (Rules) 


9 


19 


Listening 


8 


19 


Speaking 


8 


11 


Reading 


20 


2 



The data on assessment category may also be considered through the 
pattern of item scores for each of the first four skill areas. As Figure 
27 illustrates, there is no consistent pattern for any skill across the 
modal it-'es or for Recognition of Information (Rules). Moreover, there 
does appear to be some inconsistency in performance on Speaking and Listen- 
ing items within the skills requiring use of period, question mark, excla- 
mation point, and commas ^n a series. This lack of consistency on items 
may be due in part to a major difference in the difficulty of the item 
for third graders and/or to the experimental nature of the Listening and 
Speaking items in particular. The other modalities appear to have items 
which behave consistently within the skill areas, the three writing items 
being most notably consistent for each punctuation skill. 
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P unctuation Skill Area 

To gain the greatest benefit from data on the Punctuation Test, it 
is important to review not only data on the basic modalities but also any 
infonnation on the specific punctuation skills assessed. Table 12 revealed 
the conceptual scheme for this test and the reader could see that the first 
four skill areas received broader coverage than did the final six. Con- 
sequently, the number of items varies by skill area such that period, 
question mark, exclamation point have 10 items each and comma separating 
words in a series has 9 items while commas between city and state, commas 
in the date, apostrophe in contractions, commas in letter greetings, com- 
mas in letter closings, and quotation marks have 3 items each. Due to 
this variation, results will be divided into two groups. Before looking 
at these results, it is important to remember that the results for the 
first four skills are based largely on the subsample students. However, 
as discussed earlier, this group did appear to be basically representative 
of the total sample. Table 29, in the Appendix, presents the percentage 
of students correctly answering a given number of items when they are 
grouped by punctuation skill area. 

First Four Skills . The percentage of students correctly responding 
'0 5 or one-half of the items for the first four objectives was as follows: 
period (93%), question mark (76%), exclamation point (76%), and commas in 
a series (54%). When the standard was i^aised to those having three-fourths 
of the items correct (8 items for the first three skills and 7 for the 
fourth), the following percentages of students meeting that standard re- 
vealed: period (64%), question mark (43%), exclamation point (51%), and 
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commas in a series (30%), Some students answered all items correctly for 
thpse four skills: period (28%), question mark (10%), exclamation point 
(18%) and commas in a series (8%). 

It * evident from the data in this table that the achievement level 
is higher for the skill involving the correct use of the period as terninal 
punctuation. Using the exclamation point correctly has the second best 
performance, followed closely by the question mark. The skill involving 
use of commas to sepa»rate words in a series has the '.owest achievement 
level . 

Figure 28 illustrates the plot of the percent correct for individual 
items of the four skills within each of the four modalities and the Rules 
category of assessment. Though individual item frequencies are, of course, 
more variable, the items dealing with the period are always among the 
higher percentage of correct items. The question mark and exclamation 
point items fluctuate but are generally in a m'ddle range. Item percent- 
ages for the commas in a series also vary, but six of the mne conma 
items show the lowest percentage correct within this figure. This low 
percentage of correct responses for this comma skill was particularly 
noticeable in the Listening and W»^iting modalities. As discussed pre- 
viously, the difficulty of the items in this experimental instrument may 
contribute to this performance particularly for this skill in the 
Listening modality. 

Remaining Six Skills Three items were designed to measure each of 
the remaining six punctuation skills: commas used between city and state 
(Comma, City-State), commas used in the date of the year (Comma, Date), 
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commas used in the greeting (Comma, Greeting) and closing (Comma, Closing) 
of d lette^^, the apostrophe used in contractions (Apostrophe), and quo- 
ration marks before and after a direct quotation (Quotation Marks). The 
abbreviated terms in parenthesis will be used to refer to the skill areas 
^-hroughout this section. 

The highest level of achievement (in terms of percentages of studen:s 
v/ith the correct answer) was in the Apostrophe skill. Generally, use of 
commas in City-State and Date were generally achieved slightly better than 
Quotation Mark or commas in Greeting and Closing of a letter. The greatest 
variation within a skill occurred with Quotation Marks. Because the num- 
ber of items is small (3), information on what percentage of the students 
had correct answers for one-half or three-fourths of the items may be of 
limited use. However, the percentage who answered all items correctly is 
as follows: Apostrophe (52%); Comma, Date (42%); Comma, Greeting (30%); 
Comma, City-State (29?.); Comma, Closing (23%); and Quotation Mark (12%). 

Figure 30 illustrates the percent correct for each item in these si;; 
punctuation skills. The generally higher performance for the Apostrophe 
is shown graph*' cally as well as the inconsistent performance on the Quo- 
tation Mark items. It is interesting to note that performance on the 
first Uem in each skill area, which deals with Recognition of Information 
(Rules), is similar across skills while the items for the Reading modality 
are more variable. 

Teacher Ratings of Objectives and Items 

Forty-two North Carolina teachers, who were identified as excellent 
third-grade teachers within their school districts, rated the objectives 
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and items for tfie Punctuation Test. They rated objectives on importance 
by whether or not they taught these objectives in their classrooms. Items 
lor each objective were also rated for their difficulty level (what 
percentage of their students the teacher felt could answer the item cor- 
rectly) and for quality (how well the item measured the stated objective). 
Only the items on the written test involving Recognition of Information 
(Rules), Reading, and Writing were rated while objectives were rated for 
cll the four modalities and the Rules area. Teacher ratings for only the 
first four punctuation skills are discussed in this section. Complete 
results of the ratings for objectives and ite^is are presented in the 
Appendix, page 103. 

Almost all of the teachers rated the objectives as being "Very" or 
"Somewhat Important". Objectives that received the lowest of these 
(ie?ierally high ratings were the exclamation point, commas-in-a-series for 
P.eading, Writing, and Listening, and quotation marks for Reading. However, 

the Speaking area (reading sentences aloud), all objectives received 
ratings of at least 80 percent for "Very Important." The period, question 
mark, and exclamation point were rated from 88-91%, while commas-in-a- 
series was rated at 83%. Thus, commas in a <^eries is consistently rated 
somewhat lower in importance, though in varying degrees. 

Although the vast majority of teachers rated the items to be good or 
adequate measures of the stated objective, the items for the exclamation 
point and for commas in a series received slightly lower "Good" ratings. 
This, pattern is similar to the slightly lower ratings which the commas- 
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in a series objectives received. Many of these items are similar to those 
of the period and question mark so the slightly lower "Good'' ratings cou'ld 
be related to less emphasis placed by teachers on these areas in the cur- 
riculum. 

Teacher ratings of item difficulty were generally spread across the 
five levels of percent passing (0-20%; 21-40%; 41-60%; 61-80%; 81-100%). 
Because of this spread it was difficult to pinpoint a single level of 
achievement typical of teacher expectations for student performance. 
Therefore, the level rated by the highest percentage of teachers (plurality) 
v/as chosen as an indicator of teacher expectations. 

In comparing actual student performance on items to the percent pas- 
sing level chosen by a plurality of teachers, it appears that teachers 
are fairly perceptive in their judgments of how students will perform. 
On the other hand, this finding may indicate that the results of student 
performance reflect the emphasis of the language arts curricula in the 
state which, of course, may differ by individual teacher and district. 

When considering student performance in relation to teacher ratings, 
it should be remembered that these teachers, while chosen from all 
geographical regions of the state, are only indicators of general teacher 
opinion. This group of "excellent" third -grade teachers accurately esti- 
nated that the exclamation point items would be lower in percent passing 
(i.e., greater difficulty), as actual lower achievement in student per- 
formance verified. However, they slightly overestimated the performance 
of students on the skill, commas in a series, for Writing levels B and C 



(dictated and student created sentences). So although teachers expected 
lower performance here, the students did not quite meet teacher expecta- 
tions. Teachers also overestimated student performance somewhat on the 
use of the period m punctuating already written or dictated sentences 
and for the question mark in punctuating student-created sentences. 

In sunmary, while student performance matched teacher expectations 
for thp most part, the general writing skills of our students may not be 
as satisfactory as our teachers would expect. 

Sufranary and Conclusions for Objective-Based Punctuation Test 

The purpose of the objective-based assessment in Language Arts v/as 
to identify specific strengths and weaknesses of third graders on one 
broad language area, punctuation. The conceptual framework included plans 
for collecting information on four learninc PiOdalities — Listening, Speak- 
ing, Reading, and Writing as well as a fifth category concerning the 
concept of punctuation Recognition of Inforn^ation (Rules). Data was 
also collected on ten specific pinctuation skills period, question mark, 
con-jiia (series), corra (city, st-PLv), conira (date, year), apostrophe, conipa 
(letter creetinc] , comma (letter closing), and quotation nsrks with the 
first four skills receiving tr.o ireatest depth of assessnent. 

An effort was made to deternine if certain fundamental skills received 
better stud .nt response on one learning modality rathe*' than another modality. 
That IS, an ansv;er was sought for a question such as, "Do students punctuate 
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better orally than they do in written form?". In looking at individual item 
performance and the number of items achieved for each of the four modalities 
and the Recognition of Information (Rules) area, a definite or consistent 
effect by modality does not appear. Scores for the Listening modality did 
appear to be somewhat higher than other modalities with the exception of 
one item. While this may be a more fundamental or earlier developed 
modality, the experimental nature of these items should be remembered. 
The noticeably lov/er achievement or number of students who answered all 
items in Reading correctly may be, in fact, a result of the greater number 
of items for this area than the others. Thus, the data to support differences 
in performance by modality was not found in this experimental effort. 

A more noticeable modality effect does appear among the punctuation 
skills. One of the weaker skills assessed across modalities was the use of 
commas to separate words in a series. Although the individual comma items 
fluctuated within modalities, they were consistently higher in Speaking 
and almost always lower within the Writing modality. The exclamation point 
was the second most difficult skill in the Writing modality^ but performance 
was somewhat lower in Writing than in the other modalities. 
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Some interaction of modality and type of skill may be indicated. 
Perhaps there is some difference in modality as the particular skill is 
piore difficult. For example, the correct responses to the exclamation 
point items in Writing were somewhat lower than other modalities, as were 
i.he comma-in-a-series Writing items. These skills v/ere rated slightly 
less important by teachers and may still be in the developing stages in 
the third-grade curriculum. Therefore, skills that students have not 
plastered or are In the process of learning may be more easily expressed 
i.hrough certain modalities than others. This data suggests that Writing 
nay be the most difficult. 

The inconclusive effect of modality suggests several possibilities. 
First, the language arts program now in effect in the schools may have 
been able to integrate the modalities in teaching punctuation skills. 
I:econdly, while individuals demonstrate strengths and weaknesses in 
certain learning modalities, a general hierarchical development for all 
students across modalities may not exist. A third possibility may be 
*:hat a modality hierarchy exists but is evidenced only for the development 
of more difficult skills. Any conclusion shou'id be tentative due to the 
experimental nature of the conceptual framework and test items 

When the data were examined as separate punctuation skills. North 
Carolina's third graders did rather v/ell on using the period correctly In 
terminal punctuation. Using the exclamation point correctly had the 
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second best record, followed closely by the question mark in the skills 
v/hich were assessed in greatest depth. For the skills measured to a les- 
ser degree, the use of apostrophes in contractions was answered correctly 
by more students. 

The weakest student performance for the skills assessed at greater 
depth was on the skill of using commas to separate items in a series. 
For the other skills, the weakest and most inconsistent student perfor- 
mance was on the use of quotation marks before and after a direct quota- 
tion. 

Input from a select group of excellent third-grade teachers indi- 
cated the experimental instrument contained objectives which were impor- 
tant and relevant to third-grade language arts programs. Most of these 
classroom experts felt that the items for assessing these objectives 
v/ere adequate or good. Their estimates of how well students would do on 
':hese items were quite accurate. The greatest differences in teacher 
estimate and student performance occurred on general writing skills. This 
discrepancy may indicate that some students are not doing as well in 
v/riting punctuation as their teachers expect them to do. 

One of the interesting results of the test was the pattern of the 
scores on the three levels of the Writing modality. It was hypothesized 
that the levels would be increasingly difficult, from (A) adding cor. ecc 
punctuation to written sentences, to (B) writing dictated sentences and 
supplying correct punctuation, to (C) making up sentences and using the 
correct punctuation. It is evident from the item percentages in Table 
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?J and the graphic illustrations in Figure 27 that this pattern did not 
occur. The item percentage correct for each level within each of the 
•^irst four skills v^as quite consistent; decreasing in order from the 
period, to the question mark, to the exclamation point, and to commas in 
a series. Therefore, the hypothesis of the increase in difficulty from 
level to level did not hold. 

The writing samples of students illustrated a wide range of ability 
in using this modality. Many of the made-up sentences demonstrated good 
sentence structure and accurate spelling of more difficult words. These 
words (e.g., "karate") may have special significance and use for the 
student as opposed to words or terms given to him. Teachers might ex- 
plore this possibility in working with their own students in the language 
arts-reading area. 
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Description of Modalities and "Rules" Exercises 



Recogmfion of Information s Multiple choice items asking which 
punctuation mark was app^opr-ate ^or the given rule of punctuation. 
These items were read orally to minimize the effects of reading 
difficul ties. 



Example :' 

Which punctuation mark shou''d be placed at the end of a telling 
sentence? 

(A) period ( . ) 

(B) quotation marks (" ") 

(C) question mark (?) 

(D) exc^amaffon po^nt (1 ) 

LTsten-'ng : Group administered items. Students listened to a 
p^-eviously taped sentence. They were then asked to decide whether 
the way ■'p which the sentence was read matched the way the sentence 
was punctuated in their test booklets. 

Example - 

(Tape): Are you thirsty? (Read correctly, as a question) 
(Student booklet): Are you thirsty? (ye£i no 

Speaking : Individually admin-^stered. The students were asked to 
read each sentence aloud just the way the punctuation marks told 
them; that ^"s, wnh the appropriate voice inflection. They were 
given a chance to identify wo^^ds they did not know, before reading, 
an ef-^crt to min:m^ze the effects of reading difficu .les. The 
student had two trials for each sentence. 

Exampl e: 

■^h^s quest^'on r^'ghf"" 
Administrator Instructions: The child is to read this sentence in 
such a way that his voice inflection shows that it is a question 
rathe" than a statement (e.q, rise in voice at end of sentence). 
Seeded as correct, incorrect, marginal. 

Reading - MuU^ple choice format. Each item consisted of a sentence 
wh-'ch was punctuated ^e different ways. The student was directed 
to read eac^^ sentence ^ then to select the one that was punctuated 
cor>^eci'"'y . 



Example : 

Item: (A) How o^d are you? 

(B) How old are you! 

(C) How old are you. 

(copyright, Westinghouse Learning Corporation) 
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Writing : The writing skills of punctuation were measured by three 
types of items. 

A. Supplying the correct punctuation for a printed but unpunctuated 
sentence. 

Example : 

Do you like the way Ernie sings 

(copyright, Westinghouse Learning Corporation) 

B. Writing a dictated sentence and supplying the correct punctuation. 
Example : 

Administrator reads: "My father works in a store." 
(copyright, Westinghouse Learning Corporation) 

The student must write the sentenc3 and punctuate it with a period. 
He is scored only for the punctuation, not other errors. 

C. Making up a sentence for the type of sentence explained by the 
administrator and supplying the correct punctuution. 

Example : 

Administrator: "I want you to make up a sentence all by yourself, 
that asks a question. Think of a question you could ask someone. 
Now, in the space in your book, write your sentence that asks a 
question. Be sure to put the right punctuation mark at the end of 
your sentence, (copyright, Westinghouse Learning Corporation) 



69 

«0 



APPENDIX B 



70 



ERIC 



CQ 

CO LU 



o <: 



O -J 
Z Q. 

CVJ oo 
C9 GO 

—J 

CO q: 
<i: LU a: 

2: 
<: 

(/) 
>- -J 



LU (/) 

q: q 
o z 
o <a: 

LU m 

C9 LU 



LU o 



00 



aijdou4SOcl\/ 



sggjuioj 



^=rr 

CO o\ 



in tn 



O r— 



00 
CO 



&5 ^ 

CO 

col 



CO 



(•Dund leuLUjjajL) 
uoi:^euig[DX3 



(•ound ^.euLuuajL) 
*joi4san0 



poLuad? 



KO 



CO 



00 00 

KO KO 



CO 



00 <y> 



cn 

CO 



KO KO 
CO * — 

col 



O 



o o 



•f- fO 

C E 

o o 
o 

<D C 



col 00 



KO 
00 



CO 00 00 o 

LD OvJ CO 



-cut 



O O CM O 

ir> CD in CD 



CM 



cn o cn 
^ to tn tn 



- 00 



CO O CD 
00 00 00 00 



O CT> I — I — 

<x> LD 



in 



KO 



KO 
KO 



KO] 



00 i~ 
00 KO 



r-l IT) 



r~ 00 

00 



OvJI ^ 



ldI 00 



CVJ I i£> 



r-l 



cn 








c 




cn 






(/> 


c; 


0 


C 


0) 


•r- 


0 




4-> 




4-> 


-»-> 


jQ 




jQ 


CO 




0 


Z5 


•r- 




Q. 


CO 


—J 




00 





cn 

^ ^ 



col 



^ 00 CT> C\J 
LD CD 



or) LD 



r— cn 00 vo 00 O 

^ CO CO CO CO ^ 



Osjj 



00 



CVJ 

_col 



LD 00 LD lO CT» CTl 
to LD ^ VO to LO 



LD CVJ ^ LD 



col KO\ 



r>. CO o 



00 00 00 en 
KO KO KO 



cnjI ^I 



c 



CO 
cvjj 



CVJ CO 



cn Lf) CO CVJ <n 

KO KO KO KO KO 



i^lJ Ciil 



CVJ 

evil 



_Svli 



o 

CO 



3: 



7i 



ERLC 





Ll. 






O 












LU 
CO 












=> 


















LU 






> 




















CO 






LjJ 
-J 






z> 










q: 






LU 


Q 










CO 


<: 










<c 


CO 


CM 




<: 




>- 


LU 


LU 


-J 




—J 


h- 


<c 


CQ 


o 




<C 


LU 


>- 


1— 


a: 


h- 




q: 


HH 




o 


-J 




o 


<c 






o 




CO 


o 






2: 










LU 


>- 




O 


00 




z> 






CO 




CO 


2: 

LU 






h- 




o 


>— • 




bb 


















LU 






O 












LU 

CL 







0 








CM 










CM 


























00 




























00 








LO 




































CM 


















CM 










vo 








a\ 


















CM 


















vo 


















CO 














































CO 








0 


















LO 










CM 




































, 


























vo 






















































00 










cn 




















vo 
















00 


CO 






CO 














LO 


0 


as 
















CO 


00 














LO 


r— 


CM 










vo 


in 


VO 


LO 
















0 


CO 


LO 










LO 


vo 


00 


vo 


as 














0 


CO 






as 








vo 


o\ 


00 


0^ 


CM 


CM 


CM 






to 


vo 


CO 




CO 




CM 




CO 


00 




as 


0^ 


LO 


LO 


LO 






CM 


00 


as 




0 




00 




CM 


0^ 


cn 


as 








vo 








0 


0 














VO 


0 


0 








CO 






OS 








00 


00 


00 














CM 


CM 






0 


CM 


0 


0 


0 




































0 c 
















£ 


0 








<: 








0) 


C -r- 










00 


0 






0 -M 








1 








HH 




D> 








1 


1 






(/) 


E CO 


C 
















0) 


•r- C <D 




C 


cn 


c 


D> 


D> 










c 




c 




C 


c 










0) 


















oca: 




rtJ 


-0 










0) 




0 HH ' 


(/) 


0) 


rO 














0) 




Q. 


0) 










£ 


-o 


a: 


—1 


CO 








3 






0 


















Z 



















f/) 




0) 




0 




C 


(/I 


0) 


a> 


+J 


u 


c 


c 


<D (/I 


0) 


CO 0) 


-M 




C 




0) 


0) 0) cri 






-M C 


c 


•1- Q) 


2: 


I- CO 0 


3 




-0 


C7> 


Q) 


C 




•f~ 




-M 


0) 


(TJ 




0) 








11 II 




<: 00 0 



I I I 

C7> C7> 
C C C 

-M 

X T T 
3 3 3 
•It 



72 



ERIC 



b3 





co 






UJ 






h- 






»— 1 






Ll. 






O 






OC 
UJ 






CO 






z: 


















txl 






> 






1—4 






O 


-J 






-J 






1— • 










o 


CO 


















o 




LU 








h- 


CM 


CO 










LU 






I 




o 


CO 


>- 




<c 


—1 


ZD 




j- 


a. 




o 






LU 


3: 




QC 


o 




Qt: 


<c 




o 


UJ 




o 








Qt: 




CO 


o 






u. 










LU 

o 






ZD 






h- 






co 






OF 






LU 






<c 






h- 












LU 
CJ 






QC 






LU 

a. 





CO 



in 



CO 



C\J 



CO o 

C>0 



c\j 00 CO 

in oj CO 



CO 



c 
o 



U 
C 



^ CO 



in 

1^ in 



CO UD 



CO 



CO 

cy> CO 



<T» C\J 



O CO 

o o\ 



o o 
o o 



CO 



in cvj 



r— o 

lo CO 



CO 

cx> 



CO 
CO 



in 



CO 



CO 



in 



CO 



CO 



in 



OJ 



o 



CO 



OJ 



OJ 

in 



o 
CO 



^ 

00 in 



CO 



CO 



o 

CO 



CO 



CO 
OJ 



o 

OJ 



o 
in 



CO 

CO 



in 









(A 




















(D 




















•r- 


1 


















S- 
















to 
s: 


C 


<u 




-M 












o 




Pi 


Ha 


ho 
lie 






c 




c 


-M 


1 






Ol 


o> 




o 




o 


ro -M 




1 0) 


J 


O 


C 


o> 


</) 




•r- 


E c 


1/1 








•r- 


c 




O 


-M 




OJ 


^ rC 




-M 




•r- 


to 




t/) 


O 


E 




E 


</) 


0) 








<U 


O Q- 




E CO 


P= 


O 


0) 


O 


os: 


<u 


13 


X 


C 


O 


O 


Ol 


S- 






CI. 


C5' 


Ul 


O 


o 


o 




CO 


o 





73 



C/) 
CO 

h- -J 

z o 

O 2 

C/) < 



< 

- ixj 
■«Z LU 



LU 

m 

CO 

- 1 



oo 

CO 




C30 
CO 



cao 

CO 




oo 

CO 



CO 

CO 
CO 



< 

III 

o 
< 

D 

o 
z 
< 



< 

D 



Z 

o 
< 

u 
Z 
D 




Z 

p 

< 

N 



< 




CO 
Eh 

m 

D 

CO 




CM 



OO CO ^ CNJ 
CO CO CO CO 



CD OO 
CO CNI 



CO 
CNJ 



CD 
CM 



lN31VAin53 3aVd9 



ERIC 



8 



o 

CO 



iZ 
O 
cc 

O 
LU 

cr 

o 
o 

LU m 
< 



3 



< 

LU 
< 



CD 



lU ^ 

LU -J 

n _J 

S a. 

LU CO 

t CO 

-J £ 

< t 



•n < 



O 



Z 

o 



o 
o 



o o o o o 

Qi 00 K O K> 



o 



o 

CO 



o 



C9 

in 3 

^ Z 

IS* 



ERIC 



hi) 




JDa{iaOD39VlN3Daid 



1 K 





iN31VAine)3 3aVd9 



C/) 



N LL 

Zj O 

< -J 

t UJ 

D CO 2 

O ZD 




UJ 

< 
UJ 



> 

H 
CO 
UJ 

tn 

3 



to 



in 
iri 

CO 



tofl «^ 

Q3 CO 



a» 
■»— < 

GO 



< K X 

< i{ 

z 3 5 S 
O a o ^ 

< s s 

"St 




CM 




Z < 
lil 

^ ^ V 

^ I o 

111 »- ± 5{ 

Z 00 I 

O 2 52 



< O 



< 3 

UJ ^ 



o 



o 
2 z 




CD 



CSJ 



CO 



CO 
CO 



CO 



C3 

csi 

CO 



CO 



oo 

CNJ 



CSI 



C3 

C'4 



I «A I 
^ " £ 
CO 



H 
LU 

u. 
O 

UJ 
UJ 



< 

o 

O 
UJ 



CVI 
CVI 



CD 
CVI 



lN31VAine)3 3aVd9 



ERIC 



en 



LU 

o < 

< u- 
3 O 

O Cd 

•oZ > 

• 3 LU 

5CL -J 

S</> Z 

CO O 

t P 

So 

JSS 

a: QQ 

LU 




C3 



C3 




U 



03 - 



CO 
CO 





Zz6 

III ij ^ A 
O Q 2 

I- " X 

"St 



zz o 

^ i/i X 

2iS_ 

53 = 



5 < 2. 

? o z 

Hi H* C S 

ZOO X 

^ -m *^ %J 

o z 12 » 

< »- 5 2 



CO 

z 

LU 

< 

Q. 

IL. 

O 

LU 
LU 



< 

o 

O 
LU 



z z 

(A 
X ''^ 

5" 

CD 



o 
< 

o 

Z 



CM 



rooocococo cmoic^csjcm 



lN31VAm63 3aViJ0 



93 



o5 



55 



CO 




CO -I 
» 3 LU 

z o 
o p 

CO < 
UJ O 

< Q 

5 CO 



CM 



Zz6 

< p I 

a ^ u 

111 S — 

Z 3 5 S 

O Q 2 

I- " X 

< S £ 




H 
Z 
LU 

< 

Ol 

u. 
O 

UJ 
UJ 



< 
o 

O 
UJ 



LLl 

O 

O 

C/) (/) 
I \ I h- 

< 



LU 

cr 
< 

Q. 



Zj o 
-J -J 

o < LU 
OQ O 

Si 

C/) O 
LU LU 

LU 



2 CO 

> — ■ 
"75 



CO 





a 2« 

CO 

> ' 

c/> 




CO 
CNI 




Z 

Ul 

< 



0 
0 
X 
u 
(/) 

I ? 

o 

z 



< 

O Q 
•- 

< S 

:a o 

•- 

< 



z5 o 



z < 



C4 



?: ? X 



o 
o 

z « *: ^ 

T u 

O Z «/) gf) 
-r Ul 



s5 

< " 



< 3 i£ 
uj uj — 



X 

_ o 

ca X 



»- 

Z "J 

£ Z O 

K < < 

< X oc 

a »- o 

I </» I 

^ !a S 

CO 



CO 

z 

LU 

< 
Q. 



LU 
> 
LU 



o 
o 



CO^CNJCDOOCO'^CNJCD 



CO CO ^ 
CNJ CN 



CNJ 
CNJ 



CD 
CNJ 



lN31VAin53 3Q\fUD 



ERIC 



9:j 



ERIC 




^ ^ CO CO CO CO CO CSICSICMCM 

iN31VAin63 3aVd9 



ERIC 



O) CO 




3 O 

o z 

w n — * 

LU uJ 

L&J (O 



ni CO 



to 
CO 




CM 



■ ' 



H=0 




Ui 

O 

o 



< 



CM 



ooco^cmo ooco^cm 

COCOCOCOCO CMCMCMCM 



iN31VAinC>3 IQMUO 



ERIC 



98 



Q3 

OX) . 

2 oo 



CO 




UJ 

LU 2 



UJ CD 
< C/) 

a: ui 

<5 



CD IIT 

CT> oo 

fe CM 



CO 




CO 



< 

o 

Ml - 

(3 



11 

^5 



K O 

C/) CO 

C/> 

LU 



LU 

o 
o 



< 

LJL 



CMCSOOcO^CMCsaOCO^CMCD 

iN31VAinC)3 3aVd3 



ERIC 



99 



03 '—- 

2 oo 

0> CO 



CO 



CO 



CN 



Hi 

< 

z S 

< o 
-J o 

-J z 

< — 

in O d 
• ^- 2 
^ en < 

.? 00 Ll. 

"t > 

O UI 

LU O 
CD O 

< ^ 

111 




2 CO 



55 



CO 
CO 




CNJ 




I I 



^ o 



LU 

o 
o 



>- 



LU 



CO ^ CNJ 



CO CO CO CO CO CM C>l OJ CM 



lN31VAin53 3aVd9 



ERIC 




< 

UJ 

O 
< 

O 

z 
< 



< 

3 



Z 

o 
< 

>- 
u 
Z 

3 
a. 



Z 
O 

< 

N 



< 



O 
Z 



a. 



111 

o) o 



n 



CO 
M 

CO 



CM 



OO CO ^ CM C3 OO 
CO CO CO CO CO CsJ 



lN31VAin?)3 3aVd9 



CO 
CM 



CM 



ERIC 



i02 



m 



O 

LU 

o 
< 

• < 



< 

O 
Q 



C/) 
LU 
I- 
CQ 

C/) 
C/) 



S a: 
< 

UJ 
< 



h- 
z 

o 
a 

UJ 
Q. 



< 




-5f 
CO 




»- 
ae 
< 
111 
O 
< 

O 

z 
< 



< 

3 



z 
o 

< 

3 
»- 
u 

Z 

3 
a. 





Z 

o 
< 

N 



< 



o 

Z 



CL 
I/I 



O O O C3 C3 O 

OO CO Tt^ eg C3 CO 
CO CO CO CO CO Oi 

iN3ivAine)3 aavdb 



CD 
CM 



CNJ 




CO 
CO 



ERIC 



1G4 



CD 

OJ 
X 



< 
O 

o z 



CO 
LU 

< 

^ LU 

£< 

< 
<n 
CO 



CO 

CO 
LU 

QQ 

CO 
CO 

< 
LU 

o 
< 

ZD 



CO 





CO 




< 
III 
O 
< 

O 

z 
< 



3 



Z 

o 
< 

u 
Z 

a. 





O 

z 



I/I 



LU 



CO 
M 
H 



CSI 



COCOOOC^OOCNJCNJCM 



lN31VAinC)3 3aVH3 



ERJC 



C/) 
LU 

CD 
< 

< 
> 

z 
o 

< 



CO 
CO 

< 

o 



CO 
LU 

h- 



LU 
Q. 



I CO CO 
= C3S 



LU 



< 

cn 

LU 

O 
o 

C/) 
LU 

< 

a: 

LU 



o 

K 



CO CO 

<o <o ^ 



<0 <0 



CO 



CO 



CO CO CO CO 

<o <o <o <o 



o 



o 



CO 



o 



00 
CO 



o 

CO 



o 



CO 



lil 

> 



< z 



8i 



PC 



z < 

•M U Sj 

2 = > 

< O iu 

a. lu -J 



UJ 



< 
< 



< LU 
O h- 



< 



< 

M 



.?UJ 

z 
< 
q: 



Q — 
< X 

CO 

UJ z 

o 

CO 
LU 
O 
< 

UJ 



^ o 



00 
3 



o. 

O 2. - 

CO 52 

CD < 



« <o <o 

<0 >0 



o 



K 

m 



o 



o 



o 



o 



CO 



CI 

m 



CO 

III 

> 
III 



III 

> 
III 



< Z 



Ul 



I- H. 

2 < ^ 

3 « 

5 2 > 

^ O lu 

a. UJ -J 



ERIC 



lu8 



C/) 
UJ 

< 

< 



o 

< 



< 

.?UJ 



< 



< 
UJ 

cr 
o 
o 

UJ 

< 

UJ 



in 

d 



o 



O 
K 



J o 



(/> 
UJ 

Z 

< 



III 

3 



0- « 

UJ 

X 



o 



o 



o 

CO 



o 



o 

qp K 



O 
K 



CO 



10 



f CI CO 



> 



> 
tit 

ml 



lii 

> 
lii 



o o 



o o 



o o o 



< z 



o o o o 



si 



u 
< 



Z < 

■u U si 

< O w 

a. Ill -J 



ERIC 



lu'J 



CO 
LU 
-J 

cn 
< 

< 



C9 



< 

is 

3 CO CO 
.? LU GQ 

O H 
Z — 

< LU 



<o 

CO 
LU 
(T 
O 
O 
CO 

LU 

< 
LU 



00 
CO 



00 



Si 



o 

K 



K 



K 



CO 



o 



o 



o 

CO 



o 



CO 



CO CO 



p» «^ CO ^ 

3 lU ^ Ml 

lU ^ Ul > 

> S > IS 

|aj III 

-f o Q 

d o 

III — lil 



CO CO 



if 

< z 



CO CO 



lU 



CO 



CO 



CO 

z < _. 

■u U si 

5 => > 

< O w 

a. ui _i 



ERIC 



LU 
-J 

< 
< 

ZUJ 

oq: 
<^ 



•o 



3 
9 



CO 
CO 

< 

o 
>- 

CQ 

CO 
UJ 

z 
< 



< 
I- 
o 
I- 

<n 
< 

UJ 

< 

ID 
O 



< 
CO 



<o 

CD 
Ujt 

CO 



00 
<0 



CO 

10 



o 

K 



o 



o 



o 



o 



o 

<0 



o 



CO 



2 « 



o 



CO CO 



^ ^ 2 

CO ^ 



> > 

CO 



Itf 

> 

Itf 



-* o 



< z 



K 

(/I 



< 



z < _. 

m U si 

5 = > 

< a iu 

a. lu ^ 



ERIC 



ill 






— T" 


— T" 


T" 


1 


o 


o 


o 


o 


O 


o 




00 


K 





u o 
« in 



O 
u 



ERIC 



C/) 

z 

g 

g 

o 

Q. 
X 
C/) 



.2>C/) 



HI 
O 



O 
Ui 

O 
O 



i 



> 



LU 
O 

LU 

^ r 




.o ^ 

< — r 



Z 

o 

< <A 

h: ^ 

III 

u u Q 



< 

o 



z z 

UI ^ 

o * 

II 



X 
a 

oe O z 

e o 

- p < 

-.< i 

« ^ - 2 

I < :: 

-0*^0 

w z 
o 



< < z 

< I o 
O >. u 

— u C 

^ t a 



o o o p OSO'^O 
O flO K Ou'^^^ll^ 

So 

a. u 



o 



o 



ERIC 



1 14 



APPENDIX C 



103 

o 1 1 5 

ERIC 



TEACHER RATINGS 

LANGUAGE ARTS ASSESSMENT OBJECTIVES 

Questionnaire Instructions 

The third grade Language Arts Test for the 1973-74 statewide assessment 
was experimental ana was designed to look at the theory that children 
may learn differently through the various modalities. It was decided 
to look only at the area of punctuation, not because it was considered 
the most important area of language arts, but because more straight- 
forward measures could be developed for this area. Specific skills were 
identified for the area of punctuation and items were developed for each 
skill across five modalities of learning (or styles of learning): rec- 
ognition of Information, listening, speaking, reading, writing. 

Specific punctuation skills of placing the period, question mark, excla- 
mation, comma, apostrophe and quotation marks were measured for five 
modalities of learning. Three modalities (recognition of information, 
reading, and writing) were measured in group administrations . Two 
modalities (listening and speaking) were measured in individual a dminis- 
trations - This questionnaire deals only with those objectives based on 
three modalities measured in group administrations : recognition of 
information, reading, writingo 

There are two levels of objectives: (1) Intermediate objectives, 
identified by roman numerals, and (2) instructional or student perform- 
ance objectives, numbered consecutively after the intermediate objec- 
tives, You are requested to rate each of the objectives (both inter- 
mediate and instructional) for three areas of concern: Importance, 
Being Taught, District Curriculum^ There are three rating columns, one 
for each area, circle one number in each column which best reflects 
your thinking. 
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Column B, Being Taught : 



Column A, Importance : In this coiumn you should rate the objective 

for its overall importance to third grade 
students. Is it important for these stu- 
dents to know or to be able to do? Does it 
reflect an important learning skill for them? 
You should judge here cn the general impor- 
tance of the objective and not whether it is 
currently being taught. Circle one number. 

1 - Very important 

2 - Somewhat Important 

3 - Not Very Important 

Here you are asked to rate the objective as 
to whether it is being taught to your stu- 
dents. That is, do you teach to this objec- 
tive? If you are a member of a team teaching 
situation and do not teach this particular 
subject, please make a judgment as to whether 
other team teachers teach to this objective. 
(This will help us to know if the objectives 
selected are ones that the students in North 
Carolina generally encounter.) Circle one 
number. 

1 - Yes, I (or team member) teach to this 
objective. 

2 - This objective is not specifically 
covered with my students but they have 
highly similar content and activities. 

3 - No, my students are not taught thi^ 
objective- 

rhis rating asKS for your best judgment as to 
whether this objective 1s generally covered 
in the curriculum throughout your local 
school system. Thus, you might teach an ob- 
jective which few others teach and would mark 
"No". Or you might not teach a particular 
objective which many others might teach and 
would mark "Yes". This rating is, of course, 
very subjective and the results will be con- 
sidered only as general indicators. Circle 
one number. 

1 - Yes, this objective is generally 

taught. 

2 - No, this objective is not generally 

taught. 

3 - I do not know. 

The numbers in the rating columns have headings only on the first page of 
the questionnaire. In order to keep in mind the meaning of each number, 
refer back to the instructions iwhich may be separated from the question- 
naire if desired) or the front page of the questionnaire, 
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Column C, District 

Curriculum: 
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TEACHER RATINGS 



LANGUAGE ARTS: OBJECTIVE-ITEM CONGRUENCE 



Questionnaire Instructions 



In this questionnaire, you are asked to look at each item on the Lan- 
guage Arts Test and make a judgment about how well it seems to measure 
the objective for which it is listed. Two types of ratings are re- 
quested: one dealing with how well you think the item measures the 
objective with which it is listed, and the second dealing with how 
difficult you think the item would be for your students. 



Column A, Measure : Here you are to judge the excellence of the 

item as a measure of the objective listed. 
Circle the number that best reflects your 
own opinion. 

1 - A very good measure of the stated ob- 

jective 

2 - Adequate or generally acv^eptable 

measure of the objective 

3 - A poor measure of the stated objective 



Column B, Difficulty : Please rate each item on its difficulty 

level, or on what percentage of third^grade 
students you have taught you think would 
pass that item in the Spring. Ratings range 
from "1" (Very Difficult) to "5" (Very Easy). 
In order for the responses from all the 
raters to be comparable, please use the 
following guidelines for ranking each item. 
The percentages represent the number of your 
students you believe could answer the item 
correctly . 

1 - 0 - 20% answer correctly 

2 - 21 - 40% answer correctly 

3 - 41 - 60% answer correctly 

4 - 61 - 80% answer correctly 

5 - 81 -100% answer correctly 
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Below each objective, the itefn(s) measuring that objective is (are) 
listed. You must refer to that item number in the enclosed Language Arts 
Test booklet. In order to completely understand some of the items, the 
instructions for the test administrator are also necessary. Therefore, 
we have combined the administrator instructions with the test items so 
you only have to refer to one booklet. For example, items 2 and 4 are 
measures of the first objective listed. You should turn first to item 
number 2 in the test booklet, read the item completely. After com- 
pleting the item, rate it on the two scales described above: Measure 
and Difficulty . Then do the same for item number 4. Follow this pro- 
cedure for the items listed for each objective. 

The test items are generally boxed in to separate them from any adminis- 
trator's instructions. When reviewing the items, keep in mind that all 
items were read aloud to the students (except for those items measuring 
reading skills) in order to reduce the influence of poor reading on the 
answers. 

You may refer back to these instructions if necessary in order to keep 
the rating scales in mind. If helpful, you may separate this sheet of 
instructions from the rating questionnaire itself. 
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NORTH CAROLINA AND NATIONAL DEMOGRAPHIC DATA 



Variable (Year) 


Source 
Code ^ 


North Carolina 


U.S. (Average) 


Rank 


Estimated Population (1973) 


1-3 


5,273,000 


209,851,000 


12 


Median Years of Schooling Completed 
by the Population 25 Years Old 
a no uiaer \ \ f 


o 
C 


in a 
lU.D 


(12.1) 


46 


neaian ramiiy income 


0 
L 


$/,770 


($9,867) 


40 


Percent of Population that is Black 


c 


oo o 


ji .1 ) 


6 


Lano Mrea ^^quare mies^ 


o 
c 


48,798 


3,536,855 


29 


ropuiation rer oquare mie iiy/Uj 


2 


1 Ail 

104 


l57) 


17 


Percent of Population Classified 

rvUra 1 \ \ y/ \J j 




ot). U 




5 


Median Age of Population (1970) 


2 


26.6 


'(28.3) 


15 


Per-Capita Personal Income (1972) 


1-5 


$3,799 


($4,492) 


34 


Average Household Effective Buying 
Income (1972) 


1-6 


$7,441 


($8,605) 


39 


Percent of Household with Cash 
Incomes Under $3,000 (1972) 


1-6 


19.4 


(15.4) 


12 


Percent of Housing Lacking Some or 
All Plumbing Facilities (1970) 


2 


13.9 


(5.5) 


7 


Percent of Housing with 1.01 or More 
Persons Per Room (1970) 


2 


10.0 


(8.0) 


13 


Percent of Homes with Telephone 
Available (1970) 


2 


77.5 


(87.3) 


45 


otdte ano Locai lax Kevenue rer 
$1,000 of Personal Income During 
1971-72 


3-1 


$111.17 


($126.94) 


37 


rercentage ot persons co Years 
and Over with Less Than 5 Years 
of School Completed (1970) 


2 


10.0 


(5.5) 


7 


Percentage of Persons 25 Years and 
Over With 4 Years of High School 
or More (1970) 


2 


38.5 


(52.3) 


48 


Per-Capita State and Local Tax 
Revenue During 1971-72 


3-1 


$376.58 


($522.49) 


43 


Per-Cap1ta Direct General Expendi- 
tures of State and Local 
Governments During 1971-72 


3-1 


$563.45 


($801.38) 


49 
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Source 
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nUrtfl UdrUi Ilia 
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Amount of Expenditures for Local 
Scnoois by State and Local 
uovernnients per :m,uuu ot 
Personal Income During 1971-72 


3-1 


$44.98 


($53.27) 


46 


State and Local Government 
Expenditures tor am fudmc 
Education As a Percent of Total 
General Expenditures in 1971-72 


3-1 


42.7 


(38.9) 


15 


Per-Capita Total Expenditures of 
St;^tp and Local Governments for 
all Education During 1971-72 


1-1 


$240.41 


($311.60) 


45 


Per-Capita State and Local Govern- 
mental Expenditures for Higher 
Education (includes community 
colleges) During 1971-72 


1-1 


$76.80 


$76.57 


26 


Per-Capita State and Local Expendi- 
tures ^or Local (public) Schools 
(Including Capital Outlay) 
During 1971-72 


1-1 


$152.37 


($219.27) 


47 


Revised Current Expenditure Per 
Pupil in Average Daily 
Membership: 1971-72 
1972-73 
(Estimate) 1973-74 


1-2 
1-2 
1-2 


696 
765 
846 


906 
968 
1048 


36 
37 
33 



Source Code : 

First Digit is Main Scource 

1 = National Education Association 

Ranking of the States, 1974 

2 = Bureau of the Census, County 

and City Data Book, 1972 

3 = Tax Research Division, North 

Carolina Department of Revenue, 
"Ranking of North Carolina Among 
the 60 States With Respect to 
Revenues and Expenditures, 
March, 1974" 



Second Digit is Primary Source 

1 = Bureau of Census, Governmental 

Finances in 1971-72 

2 ^ NEA, Estimates of School 

Statistics 

3 = Bureau of Census, Estimates 

of the Population of the 
States 

4 = Bureau of Census, General 

Social and Economic 
Characteristics 

5 = "Survey of Current Business" 

6 = "Sales Management" 
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